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SECTION  1  -  EXECUTIVE  SUMMARY 


The  Food  and  Nutrition  Service  (FNS)  of  the  U.  S.  Department  of  Agriculture 
initiated  research  in  September  1 992  to  validate  two  sets  of  food  frequency  questionnaires 
(FFQs)  in  a  study  population  made  up  of  women  and  children  eligible  for  the  Special 
Supplemental  Food  Program  for  Women,  Infants  and  Children  (WIC).  The  purpose  was 
to  determine  the  comparative  performance  of  these  FFQs  in  ranking  respondents  with 
respect  to  the  "  true  "  dietary  intake.  In  this  study,  true  dietary  intake  was  measured  by 
three  non-consecutive  24-hour  diet  recalls  collected  through  a  telephone  interview  The 
two  food  frequency  questionnaires  tested  were  the: 

•  Harvard FFQ  -  Women's  Food  Frequency  Questionnaire  (WFFQ)  and  Children's 
Food  Frequency  Questionnaire  (CFFQ)  developed  by  Dr.  Jane  Gardner  at  Harvard 
University;  and  the 

•  Block  FFQ  -  developed  by  Dr.  Gladys  Block  at  the  University  of  California, 
Berkeley. 

Food  frequency  questionnaires  attempt  to  estimate  dietary  intake  of  an  individual 
by  asking  how  often  specific  foods  are  consumed.  Based  upon  previous  studies,  the 
Harvard  and  Block  FFQs  each  ask  about  a  list  of  foods  most  commonly  consumed  by 
participants  in  the  WIC  program.  These  two  FFQs  differ  on  several  dimensions,  such  as 
the  number  of  food  items  (Harvard,  80  items;  Block,  65  items),  specific  food  items,  the 
way  food  items  are  grouped,  the  frequency  categories,  and  scoring  methods.  The  Block 
FFQ  also  differs  from  the  Harvard  FFQ  in  that  it  asks  an  individual  to  approximate  the 
usual  portion  size  (small,  medium  or  large)  of  each  food  item  consumed. 

Both  the  Harvard  and  Block  FFQs  have  a  woman's  version  and  a  child's  version. 
The  woman's  version  is  designed  for  a  woman  to  fill  out  about  her  own  diet  while  the 
child's  version  is  designed  for  a  mother  to  fill  out  about  the  diet  of  her  child  (age  1-4). 
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Study  Population 

The  population  for  this  study  consisted  of  four  WIC  categories  and  three 
ethnic/racial  groups.  The  four  WIC  categories  studied  were: 

•  Pregnant  women; 

•  Breastfeeding,  postpartum  women; 

•  Non-breastfeeding,  postpartum  women;  and 

•  Children  ages  1 .0  through  4.9  years. 

Within  each  of  these  four  WIC  categories,  study  participants  were  recruited  to  represent 
the  following  three  "self-identified"  ethnic/racial  groups: 

•  African  American; 

•  Hispanic;  and 

•  White. 

The  study  population  was  recruited  fi"om  within  the  East,  West,  Southwest  and  Central 
regions  of  the  United  States.  The  specific  field  sites  selected  for  recruitment  were: 

•  Hempstead,  New  York; 

•  Berkeley  and  Oakland,  California; 

•  Houston,  Texas;  and 

•  Cincinnati,  Ohio. 

Sample  Design  and  Size 

A  stratified,  rectangular  sample  design  was  used  in  this  study.  For  each  of  the  two 
FFQs  (Harvard  and  Block),  approximately  75  women  in  each  of  the  three  WIC  categories 
(pregnant,  breastfeeding  and  non-breastfeeding)  and  75  children  were  sought.  On  the 
dimension  of  ethnicity,  the  target  sample  size  was  approximately  75  women  in  each  of  the 
three  ethnic  groups.  Based  on  this  design,  a  minimum  of  600  participants,  i.e.,  300  for 
each  of  the  two  FFQs  recruited  across  the  four  geographic  regions,  constituted  this 
validation  study's  desired  sample  size.  By  the  completion  of  the  data  collection  period 
(July  1993  to  January  1994)  a  combined  total  of  969  women  and  children  had  been 
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recruited,  and  of  these,  650  had  sufficiently  adequate  24-hour  recall  data  to  be  used  in  the 
final  analyses. 

Study  Data 

Participants  recruited  into  the  study  were  required  to  complete  an  initial 
administration  of  either  the  Harvard  FFQ  or  the  Block  FFQ,  three  non-consecutive  24- 
hour  diet  recalls,  and  a  second  administration  of  the  FFQ.  The  three  diet  recalls  were 
collected  by  telephone  interviews  utilizing  two-dimensional  food  models  and  were 
analyzed  with  the  Minnesota  Nutrition  Data  System  (NDS  32).  The  recalls  were  used  as 
the  reference  data  for  the  validation  study,  providing  an  estimate  of  usual  intake  for  the 
nutrients  of  interest  to  FNS  and  the  WIC  program.  In  analyzing  the  study  data,  the  recall 
reference  data  were  compared  to  the  nutrient  intake  estimates  resulting  from  the  FFQ 
administrations.  The  study  also  compared  manual  and  computerized  scoring  methods  for 
both  types  of  FFQs. 

The  following  nutrients  are  targeted  by  the  WIC  Program  and  were  examined  in 
this  study:  protein,  vitamin  A,  vitamin  C,  iron  and  calcium.  Additionally,  estimates  of 
total  energy  were  assessed  because  energy  is  important  to  pregnancy,  lactation,  growth 
and  child  development,  and  because  the  estimates  are  potentially  usefiil  for  performing 
nutrient  density  calculations. 

In  addition  to  the  validation  and  scoring  investigations,  an  evaluation  of  FFQ 
usability  was  conducted.  Data  were  collected  systematically  for  both  sets  of  FFQs,  on 
each  of  the  following: 

Usability  for  the  client 

•  Time  required  for  FFQ  completion  by  participants 

•  Amount  of  assistance  required  by  participants 

•  Number  and  type  of  errors 

Usability  for  WIC  staff 

•  Time  required  to  manually  score  FFQs 

•  Ease  of  manual  scoring 
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Assessment  of  Usability  by  WTC  Agencies 

•  Useflilness  of  FFQs  to  WIC  staff  for  nutrition  education  and  determining 
eligibility 

•  Opinions  and  recommendations  from  WIC  staff. 
Analytic  Approach 

A  central  purpose  of  FFQs,  both  for  research  and  for  WIC  purposes,  is  to  place 
individuals  along  a  distribution  of  intake  from  low  to  high.  Accuracy  of  the  point  estimates 
(group  means),  while  usefiil  for  some  purposes,  provides  no  test  whatsoever  of  the  ability  of  an 
instrument  to  determine  correctly  whether  an  individual's  intake  is  low  or  high.  FFQ  group 
means  can  be  identical  to  diet  recall  group  means  and  yet  provide  no  ability  to  rank  individuals; 
and  conversely,  FFQ  group  means  can  be  significantly  different  from  the  diet  recall  means,  but 
the  FFQ  may  rank  individuals  quite  well.  Therefore,  to  be  relevant  for  estimating  whether  an 
individual  is  at  increased  nutritional  risk,  a  proposed  FFQ  must  produce  adequate  correlations 
with  reference  data.  It  is  correlation  or  categorization  that  forms  the  criterion  for  whether  an 
instrument  can  provide  a  reasonably  accurate  estimation  of  an  individual's  location  along  the 
continuum  from  low  to  high  intake. 

RESULTS 

A  Balanced  Study  Population 

The  recruited  Harvard  and  Block  study  populations  were  well  balanced,  that  is,  not 
statistically  different  from  each  other  in  age,  distribution  among  WIC  categories,  ethnicity, 
prior  WIC  experience,  language  (Spanish  and  English)  and  education.  This  remained  true 
after  cases  with  questionably  high  diet  recall  nutrient  values  were  dropped  from  the 
analyses. 

Rapid  Completion  of  FFQs 

Both  types  of  FFQs  were  completed  in  less  than  10  minutes  by  both  African- 
Americari  and  White  study  subjects,  and  in  less  than  15  minutes  by  Hispanic  study 
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subjects.  For  all  women,  the  Block  FFQ  took  longer  to  complete  than  the  Harvard  FFQ 
with  a  median  time  of  9.5  minutes  for  Block  versus  8  minutes  for  Harvard. 

The  Block  FFQ  Is  More  Valid  for  White  and  African-American  Women 

The  Block  FFQ  achieved  higher  correlations  than  the  Harvard  FFQ  in  three- 
fourths  of  the  nutrient  correlations  examined.  Among  African- American  and  White 
women,  9  of  the  12  Block  FFQ  correlations  (six  nutrients  per  ethnic  group)  were  equal  to 
or  greater  than  0.4,  while  only  one  of  12  Harvard  FFQ  correlations  was  that  high  (note: 
perfect  correlation  =1.0).  In  addition  to  agreement  as  estimated  by  correlations,  the 
Block  FFQ  performed  better  than  the  Harvard  FFQ  for  African-American  and  White 
women  in  its  ability  to  categorize  them  as  high,  medium  or  low  with  respect  to  their  true 
dietary  intake.  The  Block  FFQ  showed  significant  agreement  between  quartile  rankings  by 
FFQ  and  24-Hour  Recall  nutrient  estimates  for  all  six  nutrients  of  interest  (energy,  protein, 
vitamin  A,  vitamin  C,  iron  and  calcium).  For  the  Harvard  FPQ,  statistically  significant 
agreement  was  seen  for  protein  and  calcium  only. 

Use  of  Small-Medium-Large  Portion  Sizes  Improves  Validity  of  the  Block  FFQ 

The  Block  FFQ  permits  respondents  to  describe  their  usual  portion  of  each  food 
item  as  small,  medium  or  large.  These  reported  portion  sizes  were  used  in  the  analyses  of 
this  validation  study.  The  effect  of  eliminating  these  multiple  portion  sizes  from  the 
questionnaire  for  purposes  of  simplification  was  examined.  When  a  medium  portion  size 
was  substituted  for  all  responses  and  the  correlations  recalculated,  the  results  were  poorer. 
The  use  of  a  standard  medium  portion  size  with  the  Block  FFQ  is  therefore  not 
recommended. 

Neither  FFQ  Is  Valid  for  Hispanic  Women 

Although  the  Harvard  FFQ  had  generally  higher  correlations  than  Block  for 
Hispanic  women,  validity  correlations  for  both  were  quite  poor  and  thus  neither  FFQ  is 
recommended  in  a  self-administered  form  for  either  nutrient  estimates  or  to  evaluate  WIC 
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eligibility.  For  Hispanic  women,  both  FFQs  could  possibly  be  used  for  nutrition  education 
and  counseling  purposes  but  not  for  eligibility  determination. 

Neither  FFQ  Is  Valid  for  Children 

Among  mothers  and  caretakers  reporting  for  children,  ages  1  -4,  it  was  found  that 
neither  FFQ  can  be  recommended  for  use  in  a  self-administered  form  to  estimate  nutrient 
intake  or  to  evaluate  WIC  eligibility.  It  is  possible,  however,  that  a  simple  set  of  brief 
behavioral  questions,  such  as  "How  often  do  you  give  your  child  fruit?"  or  "How  often  do 
you  give  your  child  vegetables?,"  may  be  more  appropriate  for  this  group.  This  approach 
could  provide  sufficiently  usefiil  information  for  education  and  counseling  purposes  and 
perhaps  for  eligibility  as  well  Obtaining  precise  nutrient  estimates  to  evaluate  WIC 
eligibility  for  children  may  not  be  possible  by  any  method  because  of  the  measurement 
errors  associated  with  proxy  reporting. 

Manual  Scoring  May  Be  Useful  to  Evaluate  Eligibility 

It  was  found  that  the  manual  scoring  of  both  instruments  is  rapid  and  easy,  once 
familiarity  with  the  scoring  system  is  attained.  The  amount  of  time  to  manually  score  the 
participants'  first  FFQ  (FFQ-1)  was  virtually  identical  for  both  Harvard  and  Block  FFQs, 
with  a  median  time  of  3.0  minutes  and  an  average  of  just  under  4  minutes  for  both.  These 
identical  averages  both  went  down  to  3.2  minutes  for  the  second  FFQ  administration 
(FFQ-2). 

In  terms  of  validity,  flexibility,  and  the  ability  to  distinguish  between  groups  with 
lower  or  higher  nutrient  intakes,  the  Block  manual  scoring  system  performed  better  than 
the  Harvard  manual  scoring.  Among  Afiican-American  and  White  women  classified  as 
either  "low"  or  "adequate"  using  the  Block  manual  scores,  the  "low"  group  had  a 
significantly  lower  mean  nutrient  intake  (24-hour  recall  data)  than  the  "adequate"  group 
for  all  five  nutrients  of  interest.  Only  one  Harvard  FFQ  manual  score  (calcium)  achieved 
statistical  significance.  Because  groups  with  low  nutrient  intakes  can  better  be  identified 
by  the  Block  manual  score,  this  score  may  be  usefiil  for  evaluating  eligibility. 
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Below  the  RDA  for  One  or  More  Nutrients  is  an  Inappropriate  Eligibility  Criterion 

On  the  basis  of  the  diet  recall  data  alone,  95%  of  the  participants  in  this  validation 
study  were  below  100%  of  the  RDA  on  at  least  one  of  the  five  nutrients  of  interest 
(protein,  vitamin  A,  vitamin  C,  iron,  calcium).  An  eligibility  criterion  of  falling  below 
100%  of  the  RDA  on  one  or  more  of  the  five  nutrients  would  then  qualify  virtually  all 
income-eligible  women  and  children. 

Usefulness  for  Nutrition  Education 

Opinions  were  solicited  ft"om  WIC  clinic  staff  in  three  states  unconnected  with  the 
research  project.  They  voluntarily  provided  assessments  of  the  FFQs'  usability.  They 
reported  that  both  FFQs  were  generally  useful  in  collecting  dietary  assessment  information 
that  was  helpful  in  providing  nutrition  education  to  WIC  clients.  Some  believed  that  the 
Harvard  manual  score  related  better  to  WIC  eligibility  criteria  and  to  nutrition  education 
models  such  as  the  "food  pyramid,"  and  they  liked  the  manual  score's  easy,  pass-fail 
system  for  rating  each  food  group.  WIC  agency  staff  also  feh  that  the  Block  portion 
quantity  question  regarding  how  much  each  time  proved  useful  for  discussing  portion  sizes 
with  clients. 

Few  Errors  by  Most  Participants 

Relatively  little  assistance  was  required  by  respondents  in  completing  the  FFQs. 
Average  assistance  scores  for  both  Harvard  and  Block  FFQs  were  between  no  assistance 
and  little  assistance.  Neither  the  Harvard  nor  the  Block  FFQ  had  a  sufficiently  large 
number  of  skipped  food  items  to  be  considered  a  serious  source  of  error. 

FURTHER  RESEARCH 

1)  Although  the  FFQs  cannot  be  recommended  for  Hispanic  women,  this  limitation 
may  be  possible  to  correct  with  further  work.  Some  examples  would  be:  examination  of 
FFQ  validity  when  administered  by  interview;  and  investigating  culturally-specific  issues 
related  to  concepts  of  food,  diet  and  frequency  of  food  intake. 
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2)  The  Block  estimates  of  vitamin  C  and  calcium  can  be  improved  by  modifying 
the  frequency  categories  that  were  used  to  assess  juices  and  milk  in  this  study's  version  of 
the  Block  FFQ.  Estimates  of  these  nutrients  in  other  validation  studies  with  the  Block 
FFQ  were  much  better  using  different  fi^equency  categories  for  juices  and  milk. 

3)  Block  manual  score  cutpoints  can  be  identified  that  will  more  accurately  reflect 
the  proportion  of  the  population  with  nutrient  intake  below  the  RDA.  The  cutpoints  for 
manual  scoring  used  in  this  study  were  set  before  the  intake  distribution  for  this  WIC 
population  was  known. 

4)  Because  neither  FFQ  worked  well  for  children,  a  brief  set  of  questions  can  be 
identified  and  tested  for  assessing  appropriate  dietary  intake  among  children. 

SUMMARY 

In  1985  the  General  Accounting  Office  (GAO)  called  for  a  more  valid  and 
consistent  method  of  assessing  dietary  risk  in  the  WIC  program  and  recommended  that 
there  be  more  standardization  in  the  way  that  WIC  eligibility  is  determined  throughout  the 
country.  This  study  has  provided  a  basis  for  meeting  these  recommendations.  The 
validity  and  limitations  of  these  two  FFQs  are  now  known.  These  results  provide  a 
foundation  for  achieving  the  desired  validity  and  consistency  in  dietary  assessment  in  the 
WIC  program. 

Among  mothers  and  caretakers  reporting  for  children,  ages  1-4,  neither  the 
Harvard  nor  Block  FFQ  can  be  recommended  for  use  in  a  self-administered  form  to 
estimate  nutrient  intake  or  to  evaluate  WIC  eligibility.  For  women,  however, 
improvements  are  still  needed  and  are  possible  for  both  FFQs.  Even  in  its  present  state,  the 
Block  FFQ  produces  correlations  with  reference  data  for  White  and  Afiican-American  WIC- 
eligible  women  which  are  not  substantially  different  fi^om  correlations  previously  demonstrated 
in  better  educated  groups.  Neither  FFQ  performs  adequately  for  Hispanic  women.  Some  of 
the  reasons  for  this  may  pertain  as  much  to  the  adequacy  of  the  reference  data  as  to  the 
adequacy  of  the  FFQs  themselves.  Thus,  the  potential  usability  of  FFQs  for  Hispanic 
populations  should  not  be  discounted,  but  fiirther  investigation  is  clearly  needed. 
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SECTION  2  -  INTRODUCTION 


2.1      STUDY  OVERVIEW 

The  U.S.  Department  of  Agriculture,  Food  and  Nutrition  Service  (FNS)  conducted 
this  study  to  evaluate  the  validity  of  two  sets  of  food  frequency  questionnaires  (FFQs)  for 
potential  use  in  screening  women  and  children  for  eligibility  in  the  Special  Supplemental 
Food  Program  for  Women,  Infants,  and  Children  (WIC).  Each  set  contained  one  FFQ 
developed  for  assessing  the  dietary  intakes  of  pregnant,  breastfeeding,  and  non- 
breastfeeding  postpartum  women  and  one  FFQ  for  assessing  the  dietary  intakes  of  children 
1-4  years  of  age  (age  12  months  through  4  99  years).  A  woman's  food  frequency 
questionnaire  (WFFQ)  and  a  child's  food  frequency  questionnaire  (CFFQ)  were  previously 
developed  by  the  Harvard  University  School  of  Public  Health  (HSPH)  for  FNS  through  a 
cooperative  agreement  (Gardner  et  al.,  1992).  In  addition,  modified  versions  of  the 
Block/National  Cancer  Institute  Health  Habits  and  History  FFQ  were  developed  and 
tested  in  this  study  The  validity  of  the  two  HSPH  food  fi"equency  instruments  and  the 
two  Block  FFQ  instruments  were  evaluated  for  low-income  women  and  young  children 
against  a  standard  reference.  The  performance  of  the  two  sets  of  FFQs  was  compared  to 
determine  which  instruments  had  the  greater  validity  relative  to  the  standard  Note  that  in 
the  remainder  of  this  report,  these  instruments  are  referred  to  as  the  'Harvard"  FFQ  and 
the  "Block"  FFQ. 

Research  objectives 

The  primary  objective  of  this  research  was  to  validate  two  pairs  of  food  fi"equency 
instruments  for  women  and  children  (ages  1-4)  with  regard  to  their  effectiveness  and 
usability  in  the  following  respects: 

•  Validity  of  nutrient  estimates  in  relation  to  estimates  based  on  multiple  24-hour 
recalls; 
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•  Ability  to  measure  dietary  intake  in  a  manner  usable  to  screen  applicants  for 
WIC  eligibility, 

•  Feasibility  of  use  in  busy  WIC  clinics,  and  acceptability  to  WIC  participants 
and  staff; 

•  Suitability  for  various  ethnic  groups;  and 

•  Accurateness  and  simplicity  of  manual  scoring. 

In  order  to  achieve  these  objectives  with  the  greatest  scientific  rigor  and  validity, 
several  other  objectives  were  also  necessary: 

•  Review  and  critique  dietary  assessment  instruments  potentially  of  use  in 
estimating  usual  dietary  intake  of  women  and  children  in  the  WIC  program; 

•  Review  and  critique  existing  manual  and  computerized  scoring  methods  for 
FFQs;  and 

•  Review  and  critique  validation  methodologies. 
2.2  BACKGROUND 

The  WIC  Program 

The  Child  Nutrition  Act  (CNA)  of  1966,  as  amended,  established  the  WIC 
Program  to  provide  supplemental  foods,  health  care  referrals,  and  nutrition  education  at 
no  cost  to  low-income  pregnant,  breastfeeding  and  non-breastfeeding  postpartum  women, 
infants  and  young  children  up  to  five  years  of  age  who  are  found  to  be  at  nutritional  risk. 
To  be  eligible,  persons  must;  1)  meet  a  State  residency  requirement;  2)  meet  an  income 
standard  or  participate  in  Aid  to  Families  with  Dependent  Children  (AFDC),  the  Food 
Stamp  Program  or  Medicaid;  and  3)  be  individually  determined  to  be  at  nutritional  risk  by 
a  competent  professional  authority. 

The  goal  of  the  WIC  Program  is  to  improve  the  health  of  program  participants 
through  provision  of 

Supplemental  Foods.  WIC  makes  available  seven  food  packages  that  are  designed 
for  different  categories  of  participants.    These  packages  contain  foods  that  are 
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good  sources  of  nutrients  most  likely  to  be  lacking  in  the  WIC  population's  diet  ~ 
protein,  iron,  calcium,  and  vitamins  A  and  C  The  food  items  provided  include: 
iron-fortified  infant  formula  and  cereal,  fruit  or  vegetable  juice,  milk,  cheese,  eggs, 
peanut  butter,  dry  beans  or  peas,  carrots,  and  tuna.  These  foods  are  not  intended 
to  provide  the  total  dietary  needs  but  rather  to  supplement  the  diets  of  participants. 

Nutrition  Education.  Nutrition  education  efforts  in  WIC  are  aimed  at  assisting  the 
individual  at  nutritional  risk  to  achieve  positive  changes  in  food  habits,  and 
consequently  improve  nutritional  status  and  prevent  nutrition-related  problems. 
The  WIC  regulations  require  that  State  agencies  spend  the  aggregate  sum  of  one- 
sixth  of  their  WIC  nutrition  services  and  program  administration  grant  on  nutrition 
education  activities  plus  their  prorata  share  of  the  $8  million  earmarked  for 
breastfeeding  promotion  and  support. 

Access  to  Health  Care.  The  WIC  Program  operates  as  an  adjunct  to  good  health 
care.  Participant  referrals  to  health  care  are  provided.  WIC  and  the  public  health 
community  work  collaboratively  to  ensure  better  health  and  nutritional  status  for  a 
vulnerable  population. 

The  program  has  undergone  rapid  expansion  since  its  inception.  Funding  has 
increased  from  $20  million  in  1974  to  approximately  $2.6  billion  in  Fiscal  Year  1991. 
Average  monthly  participation  has  increased  from  87,657  persons  in  Fiscal  Year  1974  to 
4.88  million  persons  in  Fiscal  Year  1 99 1 

The  WIC  Program  functions  administratively  at  three  levels:  Federal,  State,  and 
local.  FNS,  through  its  seven  regional  offices,  provides  cash  grants  to  designated  WIC 
State  agencies  for  program  administration  and  operations.  Regulations  governing  WIC 
are  promulgated  by  FNS,  and  FNS  Regional  Office  staff  monitor  State  agencies  for 
compliance  to  these  regulations.  WIC  State  agencies  are  responsible  for  the 
establishment,  monitoring,  and  reporting  of  local  WIC  agency  activities  to  FNS.  These 
State  agencies  allocate  funds  to  participating  local  WIC  agencies  within  their  areas.  Local 
agencies  are  most  often  city  or  county  health  departments,  but  also  may  be  any  of  a  variety 
of  public  or  nonprofit  health  or  human  service  organizations  such  as  hospitals,  maternal 
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and  child  health  groups,  or  community  action  agencies.  The  funds  received  by  local  WIC 
agencies  are  used  to  provide  supplemental  foods  to  WTC  participants  and  to  pay 
administrative  costs,  including  the  costs  of  certifying  applicants  for  eligibility  and 
providing  nutrition  education  and  counseHng. 

To  qualify  for  WIC   benefits,   an  applicant  must  meet   certain  eligibility 
requirements: 

Categorical  Status.  Eligible  categories  include  women  during  pregnancy  and  for 
the  first  6  weeks  after  delivery,  breastfeeding  women  up  to  one  year  postpartum, 
non-breastfeeding  postpartum  women  up  to  six  months  postpartum,  infants  up  to 
one  year  of  age,  and  children  ages  1  through  4  years  old. 

Income.  The  income  limit  is  set  by  each  State  agency,  but  cannot  exceed  185 
percent  or  be  less  than  100  percent  of  the  U.S.  Poverty  Income  Guideline  for  each 
family  size 

Nutritional  Risk.  Applicants  who  meet  the  categorical  and  income  requirements 
must  be  certified  by  a  competent  professional  authority  to  be  at  nutritional  risk. 
Screening  for  nutritional  risk  includes  anthropometric  measurements,  blood  tests 
for  anemia,  health  history,  and  dietary  assessment.  Nutritional  risk  may  be  based 
on  medical,  clinical,  and/or  dietary  risk  criteria. 

The  level  of  WIC  Program  operation  at  the  local  agency  level  depends  on  the  level 
of  funding  that  is  available.  For  each  local  agency,  a  maximum  caseload  is  determined, 
depending  on  its  assigned  annual  funding  level  and  predicted  caseload  turnover.  When 
local  WIC  agencies  reach  the  maximum  participation  level  with  the  available  funding,  a 
system  of  priorities  is  followed  in  allocating  'Plots''  to  eligible  applicants.  Seven  priority 
levels  are  defined,  based  on  the  applicant's  categorical  status  and  type  of  nutrition  risk 
condition,  as  follows; 

I.  Pregnant  and  breastfeeding  women  and  infants  at  nutritional  risk  as 
demonstrated  by  anthropometric  or  hematological  assessment  or  by  other 
documented  nutritionally-related  medical  condition. 
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II.  Infants  up  to  six  months  of  age  whose  mothers  participated  in  WIC  during 
pregnancy,  or  who  were  at  nutritional  risk  during  pregnancy. 

III.  Children  at  nutritional  risk,  as  demonstrated  by  anthropometric  or 
hematological  assessment  or  other  documented  nutritionally-related 
medical  condition. 

IV.  Pregnant  and  lactating  women  and  infants  at  nutritional  risk  as 
demonstrated  by  inadequate  dietary  pattern. 

V.  Children  at  nutritional  risk  due  to  inadequate  dietary  pattern. 

VI.  Postpartum  non-Iactating  women  at  nutritional  risk  based  on  either  medical 
or  dietary  criteria. 

VII.  Previously  certified  participants  likely  to  regress  in  nutritional  status 
without  continuation  of  supplemental  foods. 

State  agencies  have  the  option  of  creating  subpriorities  within  priorities  and 
expanding  priority  levels  I,  II,  III,  IV,  or  V  to  include  high-risk  postpartum  women  Four 
of  the  seven  priorities  in  the  existing  priority  system  for  WIC  eligibility  certification  are 
based  on  inadequate  diet  alone.  Eligibility  is  based  on  medical  risk  factors  as  well  as 
inadequate  diet.  Inadequate  diet  alone  is  given  lower  priority. 

Rationale  for  the  Study 

In  the  WIC  Program,  State  agencies  have  always  had  the  option  of  developing 
their  own  methods  to  assess  dietary  intake  of  participants  for  program  eligibility.  In  1985, 
a  GAO  report  entitled  'Need  to  Foster  Optimal  Use  of  Resources  in  the  Special 
Supplemental  Food  Program  for  Women,  Infants  and  Children  (WIC)"  suggested  that 
there  was  a  need  to  refine  dietary  assessment  methodology  to  make  it  more  reliable  and  to 
increase  uniformity  in  assessing  dietary  risk  across  States.  A  survey  of  State  WIC 
agencies  conducted  by  FNS  in  the  fall  of  1988  showed  that  a  wide  range  of  methodologies 
was  being  used  for  dietary  assessment.  Approximately  80  percent  of  the  State  WIC 
agencies  surveyed  were  using  a  food  frequency  questionnaire,  either  alone  or  in 
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conjunction  with  a  24-hour  recall,  to  assess  dietary  intake  of  participants.  Only  one  of  the 
63  State  agencies  responding  had  tested  the  validity  and  reliability  of  its  instrument. 

The  Focus  on  Management  (FOM)  Nutrition  Services  Standards  released  in  1988 
encouraged  States  to  use  standardized  dietary  assessment  procedures  that  were  based  on 
professionally  recognized  guidelines  and  specifically  to  use  a  food  fi-equency  questionnaire 
when  dietary  risk  was  the  only  eligibility  factor. 

To  explore  the  need  for  additional  research  in  the  area  of  dietary  assessment 
relevant  to  the  WIC  Program,  FNS  convened  a  task  force  meeting  on  dietary  assessment 
in  July,  1989,  to:  1)  identify  and  examine  dietary  assessment  methodologies  applicable  to 
the  WIC  Program;  and  2)  explore  the  possibility  of  FNS  researching,  developing  and 
endorsing  a  dietary  assessment  protocol,  methodology,  and/or  range  of  approaches  for 
State  agency  use.  The  recommendations  of  the  task  force  regarding  the  use  of  a  dietary 
assessment  instrument  for  eligibility  screening  in  the  WIC  Program  consisted  of  the 
following: 

•  FNS  should  consider  pursuing  research  in  the  area  of  dietary  assessment; 

•  A  food  fi-equency  instrument  is  the  most  appropriate  instrument  for  screening 
WIC  applicants  who  are  women  or  children,  but  not  for  infants; 

•  In  addition  to  screening  for  inadequate  diet,  the  instrument  should  also  allow 
for  triaging  of  services  needed  by  the  participant  and  for  provision  of  general 
nutrition  education; 

•  The  instrument  should  be  designed  in  a  paper  format  that  could  be  self- 
administered  by  clients  and  manually  scored/evaluated.  In  addition,  the 
instrument  should  lend  itself  to  computer  application  in  administration  and 
evaluation; 

•  Evaluation  of  the  instrument  should  take  2-5  minutes  and  be  able  to  be 
performed  by  a  paraprofessional; 

•  Two  instruments  fi^om  existing  methodologies,  if  possible,  should  be  compared 
to  a  standard  reference  to  determine  which  instrument  has  the  better  reliability 
and  validity  relative  to  the  standard; 
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•  Evaluation  of  excessive  intake  should  not  be  part  of  the  instrument,  but  could 
be  added  at  State  option; 

•  The  Continuing  Survey  of  Food  Intake  by  Individuals  (CSFII)  should  be  the 
reference  data  base;  and 

•  Dietary  inadequacy  values  would  be  determined  by  each  State  and,  to  assist  in 
that  determination,  any  point  values  used  in  scoring  would  be  defined  as  to 
how  they  correlate  with  the  percentage  of  the  RDA's  for  targeted  nutrients. 

Based  on  these  recommendations,  FNS  contracted  with  HSPH  in  1990  for  the 
development  of  two  food  fi-equency  questionnaires  and  their  accompanying  scoring 
methods,  both  manual  and  computerized,  for  use  in  determining  WIC  eligibility  for  women 
and  children.  Those  two  instruments,  and  two  instruments  developed  by  Dr.  Gladys 
Block,  were  tested  in  the  present  study. 

Any  dietary  assessment  method,  when  validated  against  a  gold  standard,  will 
produce  moderate  results  at  best.  No  method  will  agree  perfectly  with  the  gold  standard, 
for  a  variety  of  reasons  which  may  include  not  only  imperfections  in  the  test  method  but 
also  imperfections  in  the  reference  method.  If  only  one  FFQ  is  tested,  the  FFQ  will  be 
deemed  to  have  been  'Validated"  simply  on  the  grounds  that  a  validation  study  has  been 
performed.  Thus,  in  order  for  methodologies  to  be  constantly  improved,  they  must 
constantly  be  tested  against  one  another.  In  a  validation  study,  two  such  methods  must  be 
validated  against  the  same  reference  data  collected  for  the  same  number  of  days,  in  a 
population  with  the  same  age,  sex  and  demographic  characteristics,  and  with  data 
collected  under  the  same  conditions  and  using  the  same  procedures.  In  this  way,  an 
evolving  set  of  instruments  can  be  developed,  each  one  better  than  the  last  The  purpose 
of  this  research  was  to  conduct  such  a  validation,  to  identify  the  better  instrument  and 
ultimately  improve  the  methods  available  for  use  in  the  WIC  program. 
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SECTIONS  -  METHODS 


3.1      OVERALL  STUDY  DESIGN 


The  study  design  used  to  evaluate  the  validity  of  the  Harvard  and  Block  FFQs 
consisted  of  three  parts;  FFQ  administration  at  the  clinic,  three  non-consecutive  24-hour 
recalls  administered  by  telephone,  and  a  repeat  FFQ  administration  at  the  clinic  (see  Figure 
3-1).  At  the  time  of  recruitment,  participants  were  randomly  assigned  either  a  Block  or 
Harvard  FFQ.  Three  24-hour  diet  recalls  were  collected  over  a  2  to  5  week  period  to 
obtain  referent  or  "  true"  dietary  intake.  A  set  of  two-dimensional  food  models  was 
provided  to  each  participant  to  assist  in  the  quantifying  of  portion  sizes.  The  total  time 
period  from  recruitment  to  the  final  FFQ  was  approximately  five  weeks.  Both  weekday 
and  weekend  days  were  included  in  the  reference  data. 


Figure  3-1 

Schematic  of  Validation  Study  Design  for  Eacli  Type  of  FFQ  Tested 

Recruited  participants  are  randomized  into  Harvard  or  Blocl<  FFQ  groups  at  t-0 
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The  three  non-consecutive  recalls,  4  to  8  days  apart,  provided  an  estimate  of  usual 
intake  over  a  3  to  4  week  period  for  protein,  iron,  calcium,  and  vitamin  C.  Vitamin  A 
intake  is  so  variable  from  day  to  day  that  there  may  be  no  feasible  number  of  days  which 
could  provide  an  adequate  reference  against  which  the  FFQs  could  be  compared  for 
validity.  Thus,  the  estimate  of  validity  for  vitamin  A  represents  a  conservative,  low 
estimate  of  the  true  validity.  The  true  validity  for  vitamin  A  is  most  likely  higher  than 
appears  from  this  validation  study. 

Study  Population 

The  study  population  consisted  of  four  WIC  categories  and  three  ethnic/racial 
groups  (referred  to  in  this  report  as  "ethnic"  groups).  The  four  WIC  categories  studied 
were: 

•  Pregnant  women; 

•  Breastfeeding,  postpartum  women; 

•  Non-breastfeeding,  postpartum  women;  and 

•  Children  ages  1  through  4  years  (12  months  through  4.99  years). 

Within  each  of  the  four  WIC  categories,  study  participants  were  recruited  to 
represent  the  following  three  "self-identified"  ethnic  groups: 

•  African  American; 

•  Hispanic;  and 

•  White. 

The  study  population  was  recruited  in  four  distinct  geographic  areas  of  the  United 
States:  East,  West,  Southwest  and  Central  regions.  The  specific  field  sites  were: 

•  Hempstead,  New  York; 

•  Berkeley  and  Oakland,  California; 

•  Houston,  Texas;  and 

•  Cincinnati,  Ohio. 
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Sample  Size 

A  stratified,  rectangular  sample  design  was  used  in  this  study  (see  Table  3-1)  For 
each  of  the  two  FFQs  (Harvard  and  Block),  a  minimum  sample  size  of  75  women  in  each 
of  the  three  WIC  categories  (pregnant,  breastfeeding  and  non-breastfeeding)  and  a 
minimum  sample  of  75  children  was  sought.  On  the  dimension  of  ethnicity,  a  minimum 
sample  of  75  women  in  each  of  the  three  ethnic  groups,  plus  25  children  per  group, 
provides  sufficient  power  to  assess  validity  within  each  ethnic  group  and  even  greater 
power  when  all  three  ethnic  groups  are  combined.  Thus,  a  minimum  total  sample  of  600 
persons,  i.e.,  300  for  each  of  the  two  FFQs,  recruited  fi"om  four  geographic  regions  and 
made  up  of  three  ethnicities,  constitutes  the  validation  study  target  population. 


Table  3-1 

Target  Sample  Size  per  FFQ  Type  by  WIC  Category  and  Ethnicity 

African- 
American 

Hispanic 

White 

Category 
Totals 

Women 

Pregnant 

Postpartum,  Breastfeeding 
Postpartum,  Non-breastfeeding 

25 

25 
25 

25 
25 

25 

25 
25 
25 

75 
75 
75 

sub-total 

75 

75 

75 

225 

Children 

Ages  1  through  4 

25 

25 

25 

75 

Grand  Total 

Ethnic  totals 

100 

100 

700 

300 
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Evaluation  of  FFQ  Usability 

During  the  validation  study,  data  were  collected  systematically  for  both  sets  of 
FFQs,  on  each  of  the  following: 

Usability  for  the  client 

•  Time  required  for  FFQ  completion  by  participants 

•  Amount  of  assistance  required  by  participants 

•  Number  and  type  of  errors 

Usability  for  WIC  staff 

•  Time  required  to  manually  score  FFQs 

•  Ease  of  manual  scoring 

Assessment  of  Usability  by  WIC  Agencies 

•  Usefulness  of  FFQs  to  WIC  staff  for  nutrition  education  and  determining 
eligibility 

•  Opinions  and  recommendations  from  WIC  staff. 
Blind  Analyses 

To  provide  an  unbiased  comparison  of  the  Har/ard  and  Block  FFQs  during 
analysis,  the  Principal  Investigator  and  Project  Director  were  blinded  to  the  FFQ  identity 
(Harvard  or  Block)  associated  with  each  set  of  data.  Prior  to  the  examination  of  FFQ 
validity  correlations.  Harvard  and  Block  FFQ  data  were  assigned  unique  identifiers,  "FFQ- 
X"  and  "FFQ-Y,"  by  the  project's  senior  analyst  Conclusions  were  made  initially  by 
project  investigators  without  their  knowing  which  validity  correlations  belonged  to  each 
FFQ  type. 

3.2      LITERATURE  REVIEW 

One  of  the  project's  objectives  was  to  review  existing  dietary  assessment 
instruments  and  their  potential  for  use  in  estimating  usual  dietary  intakes  of  women  and 
children  in  the  WIC  Program.  This  covered  reviewing  FFQ  validation  methodologies  and 
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identifying  the  strongest  methodology  for  validating  FFQ  instruments;  and  reviewing 
existing  manual  and  computerized  methods  of  scoring  data  collected  from  FFQs  An 
extensive  literature  review  was  conducted.  The  review  was  conducted  using  reference 
sources  at  the  University  of  California,  Dr.  Block's  personal  files,  information  from  FNS, 
and  relevant  findings  fi"om  the  First  International  Conference  on  Dietary  Assessment 
Methods  (September  20-23,  1992,  St.  Paul,  Minnesota). 

3.3      DEVELOPMENT  OF  FFQS  FOR  USE  WITH  WIG  POPULATIONS 

The  intent  of  this  study  was  to  examine  two  different  FFQs,  Block  and  Harvard, 
and  determine  which  FFQ  had  the  greater  validity  relative  to  a  standard  reference.  It  was 
essential  that  both  FFQs  be  suitable  for  use  with  women  and  children  in  a  WIC-eligible 
population.  The  Harvard  FFQs  examined  in  this  study  were  the  WFFQ  and  CFFQ 
developed  by  the  Harvard  School  of  Public  Health  (HSPH)  under  a  cooperative  agreement 
with  FNS  for  use  in  screening  women  and  children  for  eligibility  in  the  WIC  Program  For 
the  purposes  of  this  study,  the  existing  Block  FFQ  was  revised  and  enhanced 
Modifications  to  both  the  Harvard  and  Block  FFQs  are  described  below  and  fiarther  in 
Appendix  E-1. 

The  English  version  of  the  Harvard  FFQ  was  used  as  developed  for  FNS.  The 
study  used  a  Spanish  version  of  the  Harvard  FFQ  produced  in  1993,  a  slightly  modified 
version  of  its  1991  Spanish  version.  Dr.  Jane  Gardner  of  the  HSPH  requested  that  the 
FFQ  (1991,  1993  copyright  versions)  be  validated  in  its  present  form  as  it  is  currently  in 
widespread  use. 

The  development  and  revision  of  an  enhanced  Block  FFQ  proceeded  through  a 
series  of  steps.  To  facilitate  this  process,  working  versions  of  the  Block  FFQ  were 
constructed  in  a  digital  format  which  could  be  easily  edited  and  modified.  Data  fi^om 
NHANES  II  identifying  the  major  food  sources  of  iron,  calcium,  protein,  and  vitamins  A 
and  C  were  reviewed  for  the  following  groups  (Block,  unpublished  data):  Blacks  Below 
Poverty,  Whites  Below  Poverty,  Black  Females  Ages  19-29,  and  White  Females  Ages  19- 
29.  Foods  that  provided  up  to  80%  of  intake  for  each  of  these  nutrients  were  examined 
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for  inclusion  in  the  Block  FFQ.  An  examination  of  Hispanic  HANES  under  separate 
funding  was  also  undertaken  by  Dr.  Block  in  order  to  incorporate  those  findings  in  the 
revised  Block  FFQ  (Block  et  al.,  1994).  Also  reviewed  were  a  complete  set  of  dietary 
assessment  instruments  used  in  WIC  programs  across  the  country. 

The  results  of  these  reviews  were  used  to  create  a  revised  Block  FFQ  that  better 
reflected  the  nutrient  sources  for  low-income  women  (African-American,  Hispanic  and 
White)  Prototype  instructions,  format  and  design  were  prepared  for  use  in  focus  group 
testing.  The  Block  FFQ  Spanish  version  was  reviewed  by  the  project's  Hispanic  diet 
specialist.  Dr.  Gabriela  Villarreal,  and  a  number  of  modifications  to  the  translations  and 
food  terms  were  incorporated  into  the  version  used  for  pretesting. 

The  design  of  the  Block  FFQ  is  described  in  further  detail  in  Appendix  E-1, 
including  the  approaches  used  in  developing  the  food  list,  portion  sizes  and  manual  scores. 

FFQ  Focus  Group  Testing 

The  project  tested  only  the  Block  FFQ  in  two  series  of  focus  groups.  Focus  group 
testing  of  the  Block  FFQ  was  conducted  at  three  WIC  clinic  sites  in  California. 
Participants  were  WIC  or  WIC-eligible  women  who  were  recruited  two  to  three  days 
prior  to  each  focus  group.  The  first  site  recruited  only  Spanish-speaking  Hispanic  women 
who  examined  only  the  Spanish  FFQ  The  second  group  consisted  of  only  African- 
American  women  and  the  third  group  was  a  mixed  ethnic  group  with  African-American, 
White  and  English-speaking  Hispanic  participants;  these  groups  reviewed  the  English 
FFQs  only. 

The  Block  FFQ  was  revised  after  use  with  the  first  two  groups.  Changes  were 
made  to  punctuation,  shading,  paper  color  and  some  Hispanic  food  terms.  Asking  FFQ 
respondents  to  use  X's  to  indicate  foods  consumed  seemed  to  work  better  than  check 
marks.  Women  completing  FFQs  for  children  requested  a  reminder  on  the  top  of  each 
page  of  the  FFQ  that  they  were  reporting  for  their  child,  not  themselves.  It  was  also  found 
that  respondents  desired  more  specificity  in  the  portion  size  descriptions  for  some  foods, 
especially  unitary  items  such  as  eggs,  hot  dogs,  tortillas,  etc.  Grouping  together  foods 
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which  specified  a  portion  size  such  as  a  teaspoon,  slice,  etc.,  rather  than  a  "small,  medium 
or  large"  portion  size  proved  more  helpful. 

The  Spanish  language  FFQ  required  more  revision  than  the  English  The 
differences  in  Puerto  Rican,  Cuban  and  Mexican-American  food  terms  needed  to  be 
examined  closely  to  balance  accuracy  for  one  group  against  introducing  confiision  for  the 
other  groups.  Discussions  with  WIC  nutritionists  and  native  speakers  in  Puerto  Rico  and 
California  helped  identify  possible  solutions,  resulting  in  simplified  food  categories  in  most 
cases.  Some  descriptions,  however,  such  as  for  soups  and  vitamins,  were  expanded. 

The  revised  Block  FFQ,  both  English  and  Spanish  versions,  was  submitted  to  a 
second  focus  group  testing  with  an  African-American  group  and  a  Spanish-speaking 
Hispanic  group.  All  previous  modifications  were  incorporated  and  appeared  to  be 
successful  in  improving  the  effectiveness  and  usability  of  the  Block  FFQ. 

The  Harvard  FFQ  was  not  focus  group  tested  in  this  study  for  several  reasons;  it 
was  not  part  of  the  original  study  proposal;  HSPH  preferred  that  the  Harvard  English  FFQ 
currently  in  use  be  validated  without  revision;  and  HSPH  elected  to  undertake  its  own 
revision  of  the  Harvard  Spanish  instrument  (1993  copyright  version).  Minor  suggestions 
for  revising  the  Spanish  FFQ,  mostly  improvements  in  food  terms,  were  provided  to  the 
HSPH  by  the  study.  All  suggested  changes  were  incorporated  into  Harvard's  revised 
Spanish  FFQ  (1993  copyright  version).  However,  the  revised  Spanish  instrument  was  not 
focus  group  tested  as  part  of  this  study.  It  should  be  noted  that  field  observations 
involving  both  WIC  clients  and  staff  had  been  performed  on  the  Harvard  FFQ  under  the 
earlier  FNS  cooperative  agreement. 

Final  FFQ  Redesign  and  Revision 

Following  focus  group  testing,  final  revisions  were  made  to  the  Block  FFQ 
including  graphic  enhancement  to  improve  ease  of  use  by  both  participants  and 
administering  staff.  A  key  improvement  was  the  incorporation  of  the  manual  scoring 
system  into  the  printed  instrument,  thus  eliminating  a  need  for  a  separate  scoring  card. 
Improvements  were  also  made  to  instructions,  pagination  and  overall  graphic  presentation. 
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Spanish  versions  of  both  Block  and  Harvard  FFQs  were  reviewed  again  by  a 
qualified,  nutritionistytranslator  who  recommended  a  number  of  minor  language  changes 
to  the  Harvard  and  Block  instruments.  The  changes  included  adding  culturally  appropriate 
synonyms  for  several  food  items.  Both  Spanish  versions  were  also  reviewed  by  a  number 
of  nutrition  professionals  working  with  low-income  Hispanic  populations  in  California, 
Texas,  Florida  and  Puerto  Rico. 

A  standardized  cover  sheet  was  graphically  designed  for  administering  all  versions 
(women's  and  children's,  English  and  Spanish)  of  the  Block  and  Harvard  instruments  used 
in  this  validation  study.  In  this  manner,  the  covers  of  both  sets  of  instruments  were  made 
to  be  identical,  thus  preventing  any  bias  due  to  appearance.  Some  minor  differences 
among  the  FFQ  covers  included  different  color  papers  for  women's  and  children's  FFQs, 
space  for  the  child's  name  as  well  as  the  mother's  on  children's  FFQs,  and  translation  of 
all  text  on  the  Spanish  versions  including  the  0MB  Disclosure  Statement.  Each  FFQ  type 
was  coded  on  the  front  cover  for  easy  identification  and  use  by  project  field  staff. 

3.4      COLLECTION  OF  FIELD  DATA 

Field  Site  Selection 

Field  sites  for  the  study  were  selected  to  provide  a  diverse  geographic  and  ethnic 
mix  among  the  study  sample.  State  and  Regional  WIG  offices  in  New  York,  California, 
Texas,  and  Ohio  were  asked  to  provide  demographic  and  client  volume  data  for  a  number 
of  specific  sites.  The  project  identified  several  possible  sites  based  on  these  data  and 
submitted  them  to  FNS  for  review  and  final  selection.  After  reviewing  this  information, 
the  final  selected  sites  were: 

•  Hempstead,  New  York; 

•  Oakland,  California; 

•  Houston,  Texas;  and 

•  Cincinnati,  Ohio. 

Initially,  it  was  believed  that  each  of  the  clinics,  with  the  exception  of  Cincinnati, 
Ohio,  would  be  able  to  provide  approximately  equal  numbers  of  African-American, 
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Hispanic  and  White  participants.  As  a  result  of  the  demographic  profile  of  the  Cincinnati 
clinic,  the  project  elected  to  recruit  only  African  Americans  and  Whites  in  Ohio  and  to 
increase  the  Hispanic  sample  recruited  in  California,  New  York  and  Texas. 

As  data  collection  proceeded,  it  became  clear  that  imbalances  in  ethnic 
representation  existed  among  all  the  sites  and  in  overall  recruitment.  The  Oakland  and 
Houston  sites  were  low  in  White  WIC  clients,  and  virtually  no  Whites  were  present  at  the 
Hempstead  site.  The  recruitment  sample  was  brought  into  balance  by  increasing  the  target 
White  sample  in  Ohio.  Additionally,  two  sites  in  California,  one  in  Berkeley  and  one  in 
Oakland,  were  added  to  the  study  to  improve  recruitment  of  both  Whites  and  Hispanics. 

Data  Collection 

Data  collection  was  conducted  from  July  21,  1993  until  January  28,  1994,  a  period 
of  192  days  (28  weeks).  A  total  of  969  women  and  children  was  recruited  with  757 
(78.1%)  completing  all  participation  requirements.  Of  these,  data  fi^om  650  participants 
(67.1%)  were  retained  for  analysis  (see  Section  4.1  for  study  population  description). 
Tables  3-2,  3-3  and  3-4  show  the  recruitment  and  retention  rates  for  All  Participants,  for 
Harvard  and  for  Block  participants,  respectively.  Table  3-5  shows  the  ethnic  distribution 
of  study  subjects  (those  who  completed  the  full  participation  requirements)  by  State. 

The  212  (21.8%)  participants  not  completing  the  study  either  dropped  out  or  were 
unable  to  be  reached  for  an  initial  24-hour  diet  recall.  Participants  who  did  not  qualify  for 
the  study  or  who  did  not  fijUy  complete  the  first  entrance  FFQ  at  the  field  site,  were  not 
counted  among  "recruited  participants"  and  were  not  used  in  the  data  analysis. 

At  the  six  clinic  sites,  participants  were  recruited  in-person  by  project  field  staff 
After  an  initial  eligibility  screening,  qualified  participants  (women  or  women  reporting  for 
their  children)  were  randomly  assigned  to  complete  either  the  Harvard  or  Block  FFQ 
(FFQ-1).  They  were  also  provided  instructions  on  how  to  prepare  for  the  24-hour  diet 
recall  interviews  and  were  given  a  set  of  two-dimensional  food  models  to  take  home. 
Following  three  successful  diet  recall  interviews  by  telephone,  participants  returned  to  the 
WIC  clinic  site  approximately  one  month  after  being  recruited  to  complete  a  second  FFQ 
(FFQ-2). 
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Table  3-2 

All  Participants  Recruited,  Completed  and  Analyzed  by  Study  Category* 

Harvard  and  Block  FFQ  Groups  Combined 

Children 

Pregnant 

Women 

Breastfeeding 

Non-breastfeeding 

All 
Women 

All  Study 
Participants 

African  American 

100 

100% 

84 

100% 

75 

100% 

90 

100% 

249 

100% 

349 

100% 

Completed 

76 

76% 

61 

73% 

65 

87% 

61 

68% 

187 

75% 

263 

75% 

Analyzed 

69 

69% 

53 

63% 

54 

72% 

56 

62% 

163 

65% 

232 

66% 

Hispanic 

94 

100% 

77 

100% 

83 

100% 

74 

100% 

234 

100% 

328 

100% 

Completed 

72 

77% 

62 

81% 

70 

84% 

48 

65% 

180 

77% 

252 

77% 

Analyzed 

59 

63% 

53 

69% 

59 

71% 

43 

58% 

155 

66% 

214 

65% 

White 

Recoiited 

73 

100% 

76 

100% 

64 

100% 

79 

100% 

219 

100% 

292 

100% 

Completed 

61 

84% 

63 

83% 

57 

89% 

61 

77% 

181 

83% 

242 

83% 

Analyzed 

S3 

73% 

50 

66% 

42 

66% 

59 

75% 

151 

69% 

204 

70% 

All  Participants 

Recruited 

267 

100% 

237 

100% 

222 

100% 

243 

100% 

702 

100% 

969 

100% 

Completed 

209 

78% 

186 

78% 

192 

86% 

170 

70% 

548 

78% 

757 

78% 

Analyzed 

181 

68% 

156 

66% 

155 

70% 

158 

65% 

469 

67% 

650 

67% 

*    Recruited  - 
Completed  - 
Analyzed  - 

Participant  completed  intake  interview  and  first  entrance  FFQ 
Participant  completed  entrance  and  exit  FFQs  and  ttiree  diet  recalls 
Participant  data  retained  in  the  core  data  set  for  analysis 
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Table  3-3 

Participants  Recruited,  Completed  and  Analyzed  by  Study  Category* 
Harvard  FFQ  Groups 

Children 

Pregnant 

Women 

Breastfeeding 

Non-breastfeeding 

All 
Women 

All  Study 
Participants 

African  American 

Recruited 

luw  /o 

^  1 

lUU  A> 

as 

1  w  /o 

4'! 

100% 

120 

100% 

170 

100% 

Completed 

41 

82% 

29 

71% 

32 

84% 

30 

73% 

91 

76% 

132 

78% 

Analyzed 

38 

76% 

26 

63% 

27 

71% 

28 

68% 

81 

68% 

119 

70% 

Hispanic 

Recruited 

50 

100% 

37 

100% 

41 

100% 

36 

100% 

114 

100% 

164 

100% 

Completed 

36 

72% 

29 

78% 

36 

88% 

22 

61% 

87 

76% 

123 

75% 

Analyzed 

30 

60% 

22 

59% 

31 

76% 

18 

50% 

71 

62% 

101 

62% 

White 

Recruited 

37 

100% 

36 

100% 

33 

100% 

42 

100% 

111 

100% 

148 

100% 

Completed 

31 

84% 

35 

97% 

27 

82% 

34 

81% 

96 

86% 

127 

86% 

Analyzed 

26 

70% 

27 

75% 

23 

70% 

33 

79% 

83 

75% 

109 

74% 

All  Participants 

Recruited 

137 

100% 

114 

100% 

112 

100% 

119 

100% 

345 

100% 

482 

100% 

Completed 

108 

79% 

93 

82% 

96 

85% 

86 

72% 

274 

79% 

382 

79% 

Analyzed 

94 

69% 

75 

66% 

81 

72% 

79 

66% 

235 

68% 

329 

68% 

*    Recruited  - 
Completed  - 
Analyzed  - 

Participant  completed  intake  inlTww  and  first  entrance  FFQ 
Participant  completed  entrance  and  Ml  FFQs  and  three  diet  recalls 
Participant  data  retained  in  the  core  data  set  (or  analysis 
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Table  3-4 

Participants  Recruited,  Completed  and  Analyzed  by  Study  Category* 

Block  FFQ  Groups 

Children 

Pregnant 

Women 

Breastfeeding 

Non-breastfeeding 

All 
Women 

All  Study 
Participants 

African  American 

Recruited 

50 

100% 

43 

100% 

37 

100% 

49 

100% 

129 

100% 

179 

100% 

Completed 

35 

70% 

32 

74% 

33 

89% 

31 

63% 

96 

74% 

131 

73% 

Analyzed 

31 

1  

0¿  /o 

97 

97 

f  -J  /o 

9fi 

Of  /o 

89 

O'r/o 

113 

63% 

Hispanic 

Recruited 

44 

100% 

40 

100% 

42 

100% 

38 

100% 

120 

100% 

164 

100% 

Completed 

36 

82% 

33 

83% 

34 

81% 

26 

68% 

93 

78% 

129 

79% 

Analyzed 

£9 

00% 

O  I 

TOO/ 

0/% 

00% 

OA 

113 

69% 

White 

Recruited 

36 

100% 

40 

100% 

31 

100% 

37 

100% 

108 

100% 

144 

100% 

Completed 

30 

83% 

28 

70% 

30 

97% 

27 

73% 

85 

79% 

115 

80% 

Analyzed 

27 

75% 

23 

58% 

19 

61% 

26 

70% 

68 

63% 

95 

66% 

All  Participants 

Recruited 

130 

100% 

123 

100% 

110 

100% 

124 

100% 

357 

100% 

487 

100% 

Completed 

101 

78% 

93 

76% 

97 

88% 

84 

68% 

274 

77% 

375 

77% 

Analyzed 

87 

67% 

81 

66% 

74 

67% 

79 

64% 

234 

66% 

321 

66% 

*    Recruited  - 
Completed  - 
Analyzed  - 

Participant  completed  intake  interview  and  first  entrance  FFQ 
Participant  completed  entrance  and  exit  FFQs  and  three  diet  recalls 
Participant  data  retained  in  the  core  data  set  for  analysis 

WIG  Dietary  Assessment  Validation  Study 
Final  Report  -  September  22,  1994 
Page  3-12 


Table  3-5 

Ethnic  Distribution  of  Study  Participants  by  Site  (State) 


California         Ohio  Texas        New  York  Total 


African  American 

133 

51% 

71 

27% 

24 

9% 

35 

13% 

263 

100% 

Hispanic 

95 

38% 

0 

0% 

64 

25% 

93 

37% 

252 

100% 

White 

56 

23% 

162 

67% 

21 

9% 

3 

1% 

242 

100% 

284 

38% 

233 

31% 

109 

14% 

131 

17% 

757 

100% 

Recruitment  and  Training  of  Field  Staff 

A  field  aide  was  employed  at  each  of  the  four  initial  sites.  The  field  aides  were 
responsible  for  screening  and  recruiting  study  participants,  administering  entrance  and  exit 
FFQs,  collecting  demographic  and  contact  information,  record-keeping  and  reporting. 
Qualifications  for  these  positions  included  knowledge  of  and  experience  with  the  WIC 
program;  an  understanding  of  food  and  nutrition  programs;  detail  orientation;  strong 
interpersonal  skills;  and  an  ability  to  work  with  WIC  staff  and  diverse  clients.  Bilingual 
Spanish/English  skills  were  required  for  positions  in  California,  New  York  and  Texas. 

Recruitment,  hiring  and  training  of  field  staff  was  conducted  sequentially  starting  in 
California,  followed  by  Ohio,  Texas,  and  then  New  York.  Considerable  difficulty  was 
encountered  in  locating  qualified  bilingual  candidates  in  Hempstead  and  Houston,  and 
extended  searches  were  required. 

The  field  staff  were  trained  over  a  period  of  four  days  immediately  following  their 
selection.  Standardized  field  training  was  conducted  at  all  sites  and  included  a  project 
orientation,  training  in  the  administration  and  scoring  of  FFQs,  review  of  forms  and  record 
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keeping,  and  an  introduction  to  the  WIC  clinic  study  site.  Two  days  of  the  training  were 
devoted  to  demonstrating  and  practicing  recruitment  and  data  collection  procedures. 

Field  Methods  and  Procedures 

Field  activities  included  screening  and  recruitment  of  participants,  administration 
and  manual  scoring  of  FFQs,  collection  of  demographic  data  at  entrance  and  exit  points, 
and  record  keeping  and  reporting.  The  initial  field  task  required  recruiting  qualified 
women  and  children  to  participate  voluntarily  in  the  study.  Field  aides  worked  in  available 
space  at  the  WIC  clinics.  The  study  accepted  only  women  or  children  who  were  in  one  of 
the  four  WIC-eligible  study  categories:  pregnant  women;  postpartum,  breastfeeding 
women  with  babies  less  than  one  year  old;  postpartum,  non-breastfeeding  women  with 
children  less  than  seven  months  old;  and  children,  ages  1-4  (reported  on  by  their  mother  or 
guardian).  Participants  were  asked  to  identify  themselves  or  their  child  as  being  either 
Afincan  American,  Hispanic  or  White.  All  qualified  participants  were  required  to  spend 
approximately  20  minutes  completing  an  entrance  FFQ  (FFQ-1),  be  available  to  complete 
three  diet  recall  interviews  by  telephone,  and  return  to  the  clinic  to  complete  a  second  FFQ 
(FFQ-2)  in  approximately  4  weeks. 

Prior  to  completing  the  first  FFQ,  each  participant  completed  an  Intake  Form 
(Appendix  C-1)  and  signed  a  Consent  Form  (Appendix  C-2).  If  the  woman  (or  her  child) 
was  determined  to  be  eligible  to  participate,  the  study  subject  was  assigned  a  unique 
identification  number  and  randomly  assigned  an  FFQ  type  (Block  or  Harvard).  At  this 
time,  an  appointment  for  completing  a  second  exit  FFQ  was  agreed  upon  and  written  on 
the  consent  form.  Participants  were  informed  they  would  receive  $30  compensation  to 
cover  expenses  upon  completion  of  the  second  FFQ. 

Each  participant  was  provided  brief  instruction  for  approximately  one  minute  on 
how  to  complete  the  initial  FFQ.  Upon  completion,  the  FFQ  was  reviewed  for 
completeness  and  responses  which  needed  to  be  clarified.  The  field  aides  recorded  the 
amount  of  assistance  required  by  each  participant  and  the  amount  of  time  needed  to 
complete  the  FFQ.  With  each  participant,  field  aides  reviewed  the  procedure  that  would 
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be  involved  in  completing  the  24-hour  diet  recalls  and  provided  the  person  two- 
dimensional  food  models  to  take  home. 

At  the  conclusion  of  the  third  diet  recall  interview,  all  participants  were  reminded 
of  their  return  appointment.  In  many  instances,  the  participant  was  also  contacted  by  the 
field  aide  a  day  or  two  prior  to  the  scheduled  return  date.  When  a  study  participant 
returned  to  complete  the  second  FFQ,  the  aides  would  then  verify  that  she  had  completed 
the  three  diet  recall  interviews.  The  participant  then  completed  her  second  FFQ  of  the 
same  type  (Harvard  or  Block)  as  completed  in  the  first  administration.  The  field  aide 
completed  an  Exit  Form  (Appendix  C-3)  confirming  the  participant's  study  category  and 
mailing  address  and  thanked  her  for  her  participation.  Participants  who  completed  both 
FFQs  and  the  three  required  diet  recalls  were  sent  a  thank-you  letter  along  with  a  U.S. 
Postal  money  order  for  $30. 

Field  Data  Collection 

Throughout  the  data  collection  period  weekly  status  reports  of  the  study  sample 
were  compiled  based  upon  the  recruitment  and  completion  figures  reported  by  field  staff 
Weekly  review  of  the  sample  status  permitted  control  of  recruitment  within  study  cells  as 
the  project  proceeded. 

To  examine  the  impact  of  seasonal  differences  and  food  availability  on  dietary 
intake,  two  distinct  periods  of  data  collection  were  defined  as  Season  "A"  and  Season 
"B."  In  the  data  analysis,  results  of  two  time  periods  were  compared:  August  1  - 
September  15  and  October  15  -  November  30.  All  data  collection  was  suspended  for  a 
four-day  period  during  Thanksgiving  and  an  eleven-day  period  during  the  Christmas 
holiday  season.  No  unusual  shiñs  in  dietary  intake  were  observed  shortly  before  or  after 
these  holiday  periods. 

Field  Data  Collection  Problems 

Several  challenges  in  field  data  collection  resulted  in  a  one-month-long  extension 
of  the  overall  data  collection  phase.  Data  collection  in  California  was  briefly  delayed 
during  the  first  month  when  a  field  aide  had  to  be  replaced.  Being  located  close  to  the 
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project  office,  this  posed  few  problems  and  a  new  field  aide  proved  highly  productive 
throughout  the  remainder  of  the  project.  During  the  second  half  of  data  collection,  the 
Texas  field  aide  encountered  personal  difficulties  which  affected  job  performance  and 
resulted  in  a  low  participant  completion  rate.  Due  to  the  expense  and  delay  in  data 
collection  that  would  have  been  required  to  replace  the  Texas  aide,  recruitment  of  new 
Houston  participants  was  ended  in  mid-November.  Recruitment  of  the  targeted  sample 
from  the  Texas  site  was  shifted  to  other  sites. 

At  all  four  sites,  field  staff  encountered  difficulty  recruiting  and  retaining  all 
categories  of  Hispanic  women.  White  pregnant  women  and  White  postpartum 
breastfeeding  women.  To  address  the  recruitment  difficulties,  recruitment  in  California, 
Ohio  and  New  York  was  continued  for  an  additional  six  weeks  (excluding  the  two  holiday 
suspension  periods).  In  addition,  two  new  sites  were  added  in  California:  the  Berkeley 
WIC  Clinic  in  Berkeley;  and  La  Clinica  de  la  Raza  in  Oakland.  The  Berkeley  clinic  served 
to  increase  the  number  of  recruited  White  and  Hispanic  participants.  La  Clinica  de  la  Raza 
assisted  with  a  targeted  recruitment  of  WIC-eligible,  postpartum  Hispanic  women. 

A  concentrated  effort  was  required  at  the  end  of  data  collection  to  recruit 
sufficient  numbers  of  non-breastfeeding  postpartum  Hispanic  women.  With  approval  of 
La  Clinica  de  la  Raza's  Board  of  Directors,  this  community  clinic  permitted  the  project  to 
recruit  postpartum  Hispanic  participants  by  telephone  from  the  clinic's  client  records. 
Recruited  participants  were  offered  an  additional  $  1 0  (a  total  of  $40)  to  compensate  for 
the  expense  of  two  visits  to  the  clinic  solely  to  complete  FFQs.  This  approach  proved 
highly  productive  and  resulted  in  a  sufficient  number  of  Hispanic  postpartum  women 
joining  the  study  during  the  last  few  weeks  of  data  collection.  A  similar  approach  was 
utilized  in  Ohio  to  recruit  White  participants  in  the  final  weeks. 

At  the  end  of  data  collection,  the  target  number  of  participants  had  been  met  or 
exceeded  in  all  study  categories  except  Hispanic  non-breastfeeding  women.  Of  the  118 
Hispanic  postpartum  women  completing  all  requirements,  59.3%  were  breastfeeding  and 
40.7%  were  non-breastfeeding. 
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3.5      COLLECTION  OF  REFERENCE  DATA 


To  assess  the  validity  of  the  FFQs,  the  FFQ  data  were  compared  with  a  reference 
data  set.  The  reference  data  set  consisted  of  three  24-hour  diet  recalls  conducted  on  non- 
consecutive  days  with  each  participant.  Diet  recalls  were  collected  by  trained  nutritionist- 
interviewers  over  a  period  of  four  weeks,  approximately  the  same  time  frame  asked  about 
during  the  administration  of  the  second  FFQ.  Diet  recalls  were  conducted  seven  days  a 
week  by  telephone  from  the  Freeman,  Sullivan  &  Co.  Computer  Assisted  Telephone 
Interviewing  (CATI)  laboratory  in  San  Francisco,  California.  Recall  data  were  collected 
utilizing  the  Minnesota  Nutrition  Data  System  (NDS-32,  Version  2.5),  software  developed 
and  supported  by  the  University  of  Minnesota  Nutrition  Coordinating  Center. 

The  Minnesota  NDS  software  was  selected  for  its  widely-recognized  effectiveness 
in  collecting  and  analyzing  dietary  data.  This  software  is  based  on  dietary  data  collection 
and  nutrient  calculation  procedures  originally  developed  for  the  Lipid  Research  Clinics  and 
the  Multiple  Risk  Factor  Intervention  Trial.  It  is  being  used  to  collect  dietary  data  in  the 
Third  National  Health  and  Nutrition  Examination  Survey  (NHANES  III).  The  NDS 
database  contains  over  16,000  foods  and  5,000  brand  name  products  and  includes  many 
ethnic  foods.  The  database  version  used  for  this  study  contained  values  for  32  nutrients 
and  9  nutrient  ratios.  The  NDS  nutrient  data  were  derived  from  USDA,  food 
manufacturers,  scientific  literature,  and  foreign  food  composition  tables. 

Recruitment  and  Training  of  Nutritionist-Interviewers 

Nutritionist-interviewers  were  recruited  through  university  placement  centers, 
university  nutrition  and  dietetic  departments  and  networks  of  nutrition  professionals,  and 
through  newspaper  advertisements.  Qualifications  for  interviewer  positions  included  being 
a  registered  or  RD-eligible  dietitian,  experience  conducting  24-hour  diet  recalls,  and 
experience  or  familiarity  with  WIC  clinics  and  their  procedures.  Eleven  nutritionist 
interviewers  were  employed  with  the  project,  five  of  whom  were  bilingual  in  Spanish  and 
English. 
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Training  of  nutritionist-interviewers  occurred  in  three  phases.  Initially,  four 
interviewers,  all  registered  or  RD-eligible  dietitians,  were  trained  by  the  University  of 
Minnesota  Nutrition  Coordinating  Center  staff  in  the  use  of  the  NDS-32  software  and  diet 
recall  interviewing  techniques.  A  second  training  conducted  by  these  trained  nutritionists 
was  held  two  weeks  later  for  four  bilingual  staff.  Individualized  training  by  project 
nutritionists  occurred  for  three  additional  staff  added  as  replacements  over  the  six-month 
course  of  data  collection. 

The  group  interviewer  training  lasted  three  days.  The  training  agenda  covered  a 
project  overview,  an  NDS-32  tutorial,  review  of  data  entry  and  editing,  methods  of 
nutrient  calculation,  and  interviewing  skills.  Interviewers  also  learned  data  entry 
procedures,  methods  of  rapid  entry,  muhiple-record  calculation,  data  management  and  use 
of  the  recipe  and  diet  history  modules. 

Following  the  initial  training,  the  first  interviewer  group  conducted  extensive 
practice  sessions,  approximately  20  hours  per  week  for  two  weeks.  The  practice  sessions 
consisted  of  completing  diet  recalls  with  each  other,  company  staff  members,  and  with 
volunteers  by  telephone.  These  trial  diet  recalls  were  evaluated  by  senior  project  staff  and 
in  group  review  sessions.  Following  the  training  of  bilingual  interviewers,  a  list  of 
Hispanic  food  equivalents  and  terms  was  developed.  Interviewers  also  developed 
standardized  approaches  for  constructing  common  Hispanic  mixed  dishes  in  NDS. 
Evaluation  and  critique  of  interview  methods  continued  weekly  through  the  first  month  of 
data  collection. 

Diet  Recall  Data  Collection 

As  participants  were  recruited  at  the  four  field  sites,  intake  forms  with  entrance 
demographic  data  were  submitted  to  the  project  office.  Each  participant's  demographic 
information  was  reviewed,  study  category  and  identification  number  checked  for  accuracy, 
and  data  entered  into  a  study  management  database.  From  the  database,  a  "call  sheet" 
was  generated  for  tracking  each  participant.  This  sheet  included  key  contact  information 
and  space  for  interviewers  to  record  interview  attempts  and  completions.    After  each 
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completed  interview,  an  NDS  printout  of  the  diet  recall  was  attached  to  the  call  sheet. 
Call  sheets  were  organized  daily  into  various  levels  of  calling  priority. 

Collection  of  three  diet  recalls  was  started  approximately  one  week  after  a 
participant  was  recruited.  Diet  recalls  were  collected  with  a  minimum  of  four  days 
between  interviews.  To  gain  a  representative  view  of  each  participant's  current  diet,  the 
interviewers  attempted  to  collect  recalls  for  one  weekend  day  and  two  weekdays.  Other 
combinations  of  days  were  accepted,  but  it  was  considered  not  acceptable  to  collect  three 
recalls  for  weekend  days  only.  Recalls  for  children  in  the  study  were  collected  from  the 
mother  or  other  guardian  who  was  most  familiar  with  the  child's  dietary  intake. 

In  rare  instances,  specific  interviews  were  determined  by  the  interviewer  to  be 
"unreliable."  If  a  participant  was  merely  having  difficulty  reporting  on  yesterday's  diet, 
the  recall  was  repeated  at  a  later  date.  If  on  a  first  interview,  it  appeared  that  a  subject 
would  not  be  able  to  provide  reliable  recall  information,  the  participant  was  dropped  from 
the  study.  Similarly,  if  a  subject  could  not  be  reached  by  telephone  within  an  initial  10-14 
day  period,  the  participant  was  dropped.  Individuals  dropped  from  the  study  were  notified 
by  mail.  In  general,  it  was  found  that  participants  needed  to  have  a  telephone  at  their 
residence  in  order  to  complete  the  recalls  successfiiUy.  Interviewers  found  it  very  difficult 
to  contact  participants  through  a  neighbor's  phone,  public  phone  or  shared  phone  after  it 
was  learned  that  this  was  the  provided  telephone  number  (despite  the  recruitment 
requirement  instructions). 

All  problems  encountered  while  conducting  recall  interviews  were  recorded  in  an 
interview  logbook.  Problems  were  then  reviewed  and  resolved  by  senior  project  staff  If 
necessary,  problem  foods  (missing  from  NDS)  or  input  problems,  were  referred  to  the 
Minnesota  Nutrition  Coordinating  Center  for  resolution.  Several  "bugs"  and  inexplicable 
error  messages  were  encountered  in  the  NDS-32  software.  These  were  reported  to  the 
Nutrition  Coordinating  Center  and  solutions  successfully  found. 

Upon  completion  of  a  subject's  third  recall  interview,  the  subject's  call  sheet  and 
recall  printouts  were  transferred  to  a  completion  file.  Participants  were  reminded  of  their 
return  appointment  to  complete  their  exit  FFQ.  The  field  aide  was  then  notified  of  the 
participant  having  completed  her  three  recalls. 
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In  all,  the  project  completed  2,654  diet  recall  interviews.  Of  these,  2,271  recalls 
(85.6%)  were  associated  with  participants  who  completed  the  study  and  383  recalls 
(14.4%)  resulted  from  participants  who  did  not  finish  or  were  dropped  out  of  the  study. 
The  amount  of  interviewer  time  required  to  contact  participants  by  telephone  and 
complete  a  recall  varied  and  became  more  efficient  during  the  course  of  data  collection. 
Analyzed  on  a  weekly  basis,  the  rate  of  completed  recalls  ranged  from  a  low  of  0.97 
recalls  per  interviewer  hour  to  a  high  of  2.25;  the  average  was  1.60  recalls  per  hour. 

3.6  FFQ  USABILITY  ASSESSMENT 

Several  regional  WIC  agencies  volunteered  to  assess  the  usability  of  both  the 
Block  and  Harvard  FFQs.  Three  agencies  were  selected  to  participate  in  this  qualitative 
assessment  based  upon  the  diversity  of  clients  served,  geographic  location  and  their  ability 
to  complete  the  assessment  within  the  project  time  frame.  The  participating  WIC  agencies 
included  Delaware,  North  Dakota  and  Puerto  Rico. 

Each  agency  was  provided  sets  of  both  Block  and  Harvard  FFQs,  identified  only  as 
"A"  and  "B"  FFQs,  for  both  women  and  children.  They  were  also  given  instructions  on 
FFQ  administration,  manual  scoring  methods  and  interpretation  of  FFQ  results.  Each 
agency  was  asked  to  use  the  questionnaires  with  a  small  number  of  WIC  clients  and  to 
seek  qualitative  assessments  from  administering  staff  as  to  the  FFQs'  usability.  The 
assessment  was  structured  around  a  set  of  specific  evaluation  questions  provided  to  each 
agency.  Relative  to  each  area  of  concern,  the  agencies  were  asked  to  compare  the 
effisctiveness  of  FFQ  "A"  and  "B."  Delaware  assessed  FFQs  in  both  English  and  Spanish, 
North  Dakota  in  English  only,  and  Puerto  Rico  in  Spanish  only. 

3.7  PREPARATION  OF  DATA 

Prior  to  analysis,  all  FFQ  data  were  edited  for  clarity  and  key  entered.  FFQ 
nutrient  calculations  were  made  utilizing  previously  developed  software  for  the  Block  and 
Harvard  instruments.  A  master  data  file  was  compiled  for  each  participant  and  included 
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the  demographic  data,  computed  FFQ  nutrient  values,  FFQ  manual  scores,  subfile  FFQ 
editing,  data  collection  observations,  and  NDS  nutrient  summary  data. 

All  paper  FFQs  were  edited  by  project  staff  prior  to  key  entry.  Exit  FFQs  were 
marked  so  that  they  would  be  distinguishable  fi"om  entrance  FFQs.  A  summary  label  was 
placed  on  the  cover  of  each  FFQ  providing  a  specific  location  to  transfer  an  entrance/exit 
code,  assistance  score,  scoring  time,  total  number  of  errors,  and  a  participant's  FFQ 
completion  time. 

Editors  reviewed  all  FFQs  for  errors  and  completeness.  Food  items  that  were 
double  marked  or  left  blank  were  coded  and  counted  as  an  error.  On  Block 
questionnaires,  if  the  fi-equency  of  a  food  was  marked  as  "Almost  Never"  and  the  amount 
was  blank,  it  was  not  coded  as  an  error.  All  editing  decisions  were  reviewed  and  verified 
by  senior  project  staff. 

Key  Entry  of  FFQ  Data 

FFQ  data  were  double-key  entered  and  verified  by  an  outside  key  entry  vendor. 
Test  batches  were  provided  to  the  vendor  and  the  data  entry  compared  to  cleaned  data 
entered  in-house.  In  the  test  batches  entered  by  the  vendor  (114  records),  there  was  an 
error  rate  of  0.08%,  a  rate  less  than  the  0.20%  rate  specified  for  key  entry  accuracy.  Data 
entry  of  the  entire  FFQ  data  set  was  compared  to  a  random  sample  of  records  that  had 
been  entered  and  cleaned  in-house.  The  overall  key  entry  error  rate  was  found  to  be 
0. 12%,  well  below  the  maximum  allowable  error  level. 

Calculating  FFQ  Nutrient  Values 

Data  for  both  Block  and  Harvard  FFQs  were  processed  using  their  respective 
software  to  calculate  estimated  nutrient  values.  The  Block  FFQ  data  were  processed  by 
Dr.  Block  using  a  program  which  permits  "batch"  analysis  (i.e.,  processing  of  multiple 
records  in  a  single  operation).  However,  the  Harvard  program,  WICENTER,  is  primarily 
designed  for  processing  FFQs  one  at  a  time.  For  this  study's  purposes,  a  quasi-batch 
process  method  was  developed  for  use  with  WICENTER.  It  required  structuring  a  data 
file  of  multiple  records  in  a  dBase  format  readable  by  WICENTER  and  then  opening  and 
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closing  each  FFQ  record  in  "edit  mode"  causing  nutrient  values  to  be  calculated  and 
written  into  the  appropriate  fields  in  the  dBase  file.  This  was  done  separately  for  women 
and  children. 

It  was  confirmed  through  prior  testing  that  although  the  WICENTER  program  for 
women  (ENTERW)  performs  reliable  nutrient  calculations,  this  was  not  true  for  the 
children's  program  (ENTERC).  When  the  nature  of  the  error  was  understood,  it  became 
possible  to  produce  reliable  nutrient  calculations  using  ENTERC.  The  error  found  was 
that  in  certain  instances  related  to  the  entry  sequence  of  FFQ  records  the  wrong  portion 
sizes  are  used  by  ENTERC.  Tests  were  conducted  to  insure  that  the  Harvard  FFQ 
nutrient  calculations  for  the  children's  data  used  in  this  validation  study  were  the  accurate 
values  intended  by  the  WICENTER  designers.  (These  tests  and  their  results  are  described 
in  detail  in  Appendix  E-2.) 

ENTERC  requires  a  "session  date"  (the  date  of  data  collection)  and  birth  date  to 
calculate  age  so  that  different  portion  sizes  can  be  appropriately  applied  for  children  ages 
1-2  and  ages  3-4.  In  this  study,  the  recruitment  date  was  used  as  the  "session  date"  for 
both  the  first  and  second  FFQ  calculations.  This  kept  each  child's  age  the  same  for  the 
calculation  of  nutrient  values  for  both  FFQ-1  and  FFQ-2.  The  reported  age  at  the  time  of 
recruitment  was  used  for  the  Block  calculations  for  both  FFQ-1  and  FFQ-2. 

Data  Cleaning  and  Data  Quality 

In  a  study  such  as  this,  there  are  numerous  sources  of  error,  in  both  the  reference 
data  (the  diet  recalls)  and  the  test  instruments  (the  food  fi^equency  questionnaires).  An 
extraordinary  amount  of  effort  was  devoted  in  this  study  to  achieving  the  best  data  quality 
obtainable  given  the  nature  of  the  study  population  and  the  data  collection  methods 
Cleaning  and  editing  of  the  data  took  place  at  several  levels,  and  each  is  addressed 
separately  below.  In  addition,  this  process  leads  to  observations  about  the  quality  of  the 
data,  which  are  also  discussed. 
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Editing  the  Diet  Recall  Data 

The  reference  data  in  this  study  consisted  of  three  non-consecutive  24-hour  recalls, 
obtained  by  telephone  over  a  period  of  approximately  four  weeks.  To  help  estimate 
portion  size,  study  participants  used  Posner's  two-dimensional  food  models  (Posner, 
1992).  After  the  diet  recall  data  were  collected,  extensive  editing  was  conducted  to 
remove  or  minimize  what  appeared  to  be  erroneous  data.  This  editing  was  done 
completely  without  knowledge  of  the  participant's  FFQ  assignment. 

During  data  collection,  several  steps  were  taken  to  insure  accuracy.  The  telephone 
interviewers  were  monitored  randomly  throughout  the  study  by  a  supervisor  and  regular 
weekly  meetings  were  held  to  discuss  problem  situations  and  maintain  consistency  of 
interviewing  technique.  To  ensure  against  data  loss,  each  24-hour  recall  was  printed  and 
filed  by  identification  number,  which  also  permitted  later  examination  of  unusual  data. 
Despite  these  efforts,  some  coding  errors  did  take  place,  as  discussed  below. 

Editing  at  the  Nutrient  Level 

Prior  to  preparing  the  final  data  set  for  analysis,  nutrient  values  fi^om  vitamin 
supplements  were  identified  and  subtracted  fi-om  total  nutrient  values,  resulting  in  food- 
only  nutrient  values.  Otherwise,  no  changing  of  data  was  done  with  regard  to  actual 
nutrient  content  assumptions  of  particular  foods.  However,  an  examination  of  the  NDS 
database  suggested  that  some  inappropriate  nutrient  content  assumptions  exist  in  the 
nutrient  data.  These  may  have  contributed  to  misestimations  in  the  recalls  and  poor 
correlations  or  incorrectly  high  correlations  between  the  FFQs  and  the  recall  data.  These 
should  be  the  source  of  fiiture  investigations. 

An  example  serves  to  illustrate  this  problem:  the  calcium  content  of  Kool  Aid. 
Certain  extreme  outliers  in  the  calcium  data  led  to  an  examination  of  particular  recalls,  and 
to  the  discovery  that  in  many  cases  the  source  was  the  supposed  calcium  content  of  Kool 
Aid.  For  some  Kool  Aid  codes,  the  NDS  system  attributes  a  substantial  calcium  content; 
in  one  respondent,  two  glasses  of  Kool  Aid  supposedly  provided  10%  of  the  daily  calcium 
requirement.  Nutritionists  at  Kraft  General  Foods,  however,  indicate  that  there  is  no 
calcium  in  Kool  Aid.   Discrepancies  and  possible  errors  in  vitamin  C  were  also  noted. 
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None  of  these  data  were  changed,  but  it  is  likely  that  there  are  remaining  errors  in  the 
recall  calcium  and  vitamin  C  estimates,  particularly  although  not  exclusively  within  the 
children's  data. 

Editing  at  the  Food  Level 

Because  of  extreme  outliers  in  vitamin  C  and  calcium,  individual  food  codes  used 
by  coders  in  the  recalls  were  also  examined.  Kool  Aid  was  again  found  to  be  a  source  of 
problems.  When  a  subject  indicates  consuming  Kool  Aid,  the  coder  must  select  among  a 
list  of  Kool  Aid  codes.  The  first  code  on  the  list  refers  to  the  dry  Kool  Aid  powder,  rather 
than  the  reconstituted  beverage.  In  several  cases,  the  interviewer  had  selected  that  code, 
but  had  applied  the  portion  size  for  the  reconstituted  beverage.  In  one  example  this 
resulted  in  a  vitamin  C  intake  of  4,572  mg.  Rather  than  correcting  these  codes,  the  entire 
recall  in  which  they  occurred  was  deleted  This  resulted  in  the  deletion  of  one  of  the  three 
recalls  for  20  persons,  two  of  the  three  recalls  for  two  persons,  and  all  recalls  for  two 
persons. 

Editing  at  the  Single  Recall  Level 

Quite  often,  individual  nutrient  estimates  derived  fi^om  the  24-hour  recalls  and 
two-dimensional  models  were  improbably  high,  values  such  as  300  mg  of  protein,  or  700 
mg  of  vitamin  C  fi^om  food.  Consequently,  a  major  editing  activity  involved  examining  the 
nutrient  estimates  fi^om  an  individual's  set  of  three  recalls,  and  deleting  recalls  in  which  the 
estimate  for  one  of  the  days  was  extremely  different  fi^om  that  individual's  other  days. 

There  are  two  rationales  for  this  approach.  First,  why  delete  the  entire  recall 
rather  than  attempting  to  correct  the  erroneous  data?  It  was  often  not  clear  where  the 
error  was,  whether  in  the  choice  of  food  code,  choice  of  portion  size  model,  or  several 
errors  in  several  foods.  The  correct  answer  was  unknown.  Thus,  any  actual  'correcting' 
of  the  individual  respondent's  data  was  inappropriate. 

Second,  why  examine  an  individual's  24-hour  recall  in  comparison  with  that 
individual's  other  two  recalls,  rather  than  simply  excluding  persons  who  were  outliers  on 
nutrients  overall?  A  particular  nutrient  value  in  a  diet  recall  might  not  be  unusually  high 
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for  the  population,  and  would  not  be  detected  as  an  outlier;  but  when  viewed  in 
comparison  with  a  subject's  other  recalls,  it  could  be  seen  that  a  particular  value  was 
suspect  for  that  individual.  For  example,  while  100  mg  of  protein  for  a  child  in  a  day 
would  not  have  been  defined  as  an  outlier  for  the  population  as  a  whole,  the  child's  other 
two  days'  values  of  28  mg  and  3 1  mg  made  it  appear  to  be  extremely  unlikely  for  that 
individual.  Examination  of  a  large  sample  of  actual  recalls  led  to  the  development  of 
decision  rules  with  which  to  attempt  to  differentiate  consistently  and  systematically 
between  probably  erroneous  recalls  and  recalls  that  were  legitimately  high.  These  decision 
rules  are  shown  in  Appendix  E-3 . 

As  a  resuh  of  the  edits  at  this  individual  recall  level,  153  of  the  757  remaining 
study  subjects  had  fewer  than  three  recalls;  132  had  two  recalls  remaining,  19  had  only 
one  recall,  and  2  records  were  completely  dropped  because  they  had  no  recalls  surviving 
this  editing  process.  The  recall  average  nutrient  estimate  was  calculated  using  the 
appropriate  denominator  (one,  two  or  three)  for  these  individuals. 

Editing  at  the  Average  Nutrient  Level 

After  editing  the  recall  data  at  the  individual  24-hour  recall  level,  some  extreme 
outliers  remained  even  for  the  nutrient  estimates  based  upon  the  average  of  the  individual's 
three  (or  fewer)  days.  To  examine  this  distribution,  stem  and  leaf  plots  were  displayed,  for 
women  and  children  separately,  for  each  nutrient.  An  example  of  this  is  shown  for  protein 
for  women  in  Figure  3-2. 

It  can  be  seen  that  for  17  women,  the  average  daily  intake  of  protein  was  estimated 
to  be  above  160  g.  For  comparison,  the  median  in  NHANES  II  one-day  data  for  low- 
income  women  in  this  age  range  was  55  g  and  the  95th  percentile  was  1 13  g.  These  high 
values  were  flagged  by  the  statistical  software  program  and  represent  values  that  are  more 
than  two  standard  deviations  above  the  mean.  For  consistency  across  all  women  and  all 
children,  all  such  flagged  outliers  were  dropped  fi^om  fiirther  analysis,  representing  14%  of 
the  retained  women  and  13%  of  the  retained  children.  The  study  subject  was  dropped, 
rather  than  just  the  individual's  particular  nutrient,  because  erroneously  high  values  had 
implications  for  other  nutrients  (protein  and  iron,  for  example),  and  severe  overestimates 
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Figure  3-2 

Example  of  Stem-and-Leaf  Plot  for  Recall  Protein  (Women) 
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suggested  a  possible  pattern  of  inaccurate  reporting.  Unless  specifically  noted,  all  analyses 
presented  were  performed  on  the  core  data  set  of  650  study  subjects  for  whom  each  of  the 
recalls  used  were  judged  to  be  reliable 

The  three-day  mean  nutrient  levels  that  caused  study  subjects  to  be  dropped  as 
outliers  are  shown  in  Table  3-6,  together  with  comparative  data  fi-om  national  surveys. 
The  NHANES  II  data  are  based  on  a  single  24-hour  recall  and  would  normally  have  a 
wider  distribution,  and  therefore  a  higher  95th  percentile,  than  would  data  fi'om  three  days 
such  as  were  collected  in  this  study.  The  data  are  for  women  18-24  and  male  children  1-2, 
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Table  3-6 

Applied  Nutrient  Cutpoints  for  Identifying  Recall  Outliers 

Compared  with  National  Survey  Data 

Recall  Cutpoints 

NHANES  II 

CSFII 

Applied  in  Study     95th  Percentile    90th  Percentile 

Women 

Energy  (kcal) 

4,260 

2,877 

2,172 

Protein  (g) 

160 

113 

91.3 

Vitamin  A  (RE) 

2,607 

1,498 

Vitannin  C  (mg) 

359 

290 

124 

31.5 

20.3 

15.5 

Calciunn  (mg) 

2,115 

1.511 

1,093 

Children 

Energy  (l<cal) 

2,541 

2,156 

1,989 

Protein  (g) 

103 

91 

79.6 

Vitamin  A  (RE) 

1,556 

1,386 

Vitamin  C  (mg) 

217 

237 

136 

iron  (mg) 

21.5 

19.7 

15.7 

Calcium  (mg) 

1,616 

1,706 

1,235 

below  the  poverty  level.  The  CSFII  data  are  for  the  low-income  CSFII  study  and  are 
based  on  the  average  of  four  days  of  data,  consequently,  the  distributions  should  be  similar 
to  the  present  study. 

It  can  be  seen  from  Table  3-6  that  in  most  cases  the  "outlier"  criteria,  which  were 
derived  from  the  actual  data  distribution,  were  fairly  generous.  The  energy  cutpoint  for 
women  of  4,260  kcal  was  almost  1,400  kcal  higher  than  the  NHANES  11  95th  percentile. 
The  calcium  cutpoint  was  600  mg  higher  than  the  NHANES  II  95th  percentile.  The  other 
cutpoints  for  women  seem  similarly  justifiable  as  levels  above  which  the  data  may 
represent  inaccurate  reporting.  For  calcium  and  vitamin  C  in  children,  however,  it  may  be 
that  some  who  were  excluded  did  have  legitimately  high  values.  On  the  other  hand,  it 
should  also  be  noted  that  erroneously  high  values  can  occur  in  the  NHANES  II  data,  as 
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well.  It  might  even  have  been  valuable  to  apply  still  lower  outpoints,  perhaps  defined  as 
two  standard  deviations  above  the  CSFII  four-day  mean  if  CSFII  standard  deviations  data 
had  been  readily  available.  However,  the  approach  shown  below,  based  on  conventionally 
defined  extremes,  appeared  justifiable  after  detailed  examination  of  the  actual  study 
subjects'  recalls. 

It  should  also  be  noted  that  the  exclusion  criteria  for  the  recall  data  involved 
identifying  cases  in  which  the  whole  day's  nutrient  estimate  was  extreme.  Thus  there  are 
undoubtedly  estimates  for  an  individual  food  that  are  incorrect,  but  that  did  not  cause  the 
whole  day  to  be  extreme,  and  thus  are  not  detected.  Such  estimates  would  nevertheless 
cause  misestimates  of  that  individual's  intake.  Furthermore,  it  should  be  noted  that  the 
resulting  data  set  still  contains  high  values,  such  as  a  three-day  average  protein  estimate  of 
150  mg,  that  fell  within  the  selected  cutpoint,  but  may  be  of  questionable  accuracy 

These  editing  procedures  in  the  recalls  left  650  study  subjects  in  the  core  data  set 
for  analysis.  In  the  results  tables  of  Section  4,  this  is  what  is  referred  to  as  "No  FFQs 
Dropped"  or  "All  Cases  Included,"  that  is,  the  FFQ  outliers  are  included,  but  questionable 
recall  data  are  not  a  part  of  this  core  data  set. 

Usefijlness  of  the  Recall  Editing  Procedures 

Poor  correlations  between  FFQs  and  recall  data  can  result  not  only  fi'om  failures  in 
the  FFQs,  but  also  from  errors  in  the  recall  data.  The  editing  procedures  above  were  an 
attempt  to  improve  the  quality  of  the  reference  data,  by  removing  probably  erroneous 
data,  and  thereby  provide  the  clearest  test  of  the  FFQs.  To  test  whether  these  extensive 
edits  were  in  fact  justified,  the  correlations  shown  in  Section  4.3  were  rerun  after  adding 
back  all  of  the  recalls  and  individuals  that  had  been  dropped  due  to  the  editing  decisions. 
The  resulting  correlations  were  in  fact  slightly  lower  for  most  comparisons,  suggesting 
that  the  editing  procedures  had,  in  fact,  been  successfiil  in  identifying  at  least  some  of  the 
erroneous  data.  As  discussed  below  under  "Data  Quality  Issues,"  it  is  likely  that 
questionable  data  still  exist  in  the  recall  data  set. 
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Editing  the  FFQ  Data 

Visual  editing  of  the  food  frequency  questionnaires  took  place  immediately  upon 
their  completion.  The  aide  at  each  site  examined  them  for  omissions,  double  marks  and 
suspicious  data  (e.g.,  many  high  frequencies  or  many  "nevers").  These  were  clarified  with 
the  respondent  immediately  and  the  correct  response  recorded.  Computerized  editing  to 
identify  questionable  data  in  the  food  frequency  questionnaires  was  performed  according 
to  the  methods  of  the  respective  authors. 

For  the  Harvard  FFQ,  the  only  exclusion  criterion  for  questionable  data  was 
related  to  the  total  energy  estimate:  FFQ  energy  estimates  that  exceed  4,500  kcal  were 
considered  suspect.  All  such  responses  were  excluded  from  analyses  labeled  "Outlier 
FFQs  dropped."  All  FFQ  data,  including  those  exceeding  4,500  kcal,  were  included  in 
analyses  labeled  "No  FFQs  Dropped."  For  children,  no  Harvard  exclusion  criteria  had 
been  identified.  To  identify  an  exclusion  level  for  children  comparable  to  Harvard's  prior 
rule  for  women,  the  standard  deviation  reflected  by  4,500  kcal  was  identified  in  the 
women's  data.  The  same  standard  deviation  was  applied  to  the  children's  data  (on 
normalized  values).  The  cutpoint  for  Harvard  children,  identified  in  this  way,  was  3,100 
kcal.  Thirteen  percent  of  Harvard  women  and  13%  of  Harvard  children  were  excluded  by 
these  criteria. 

For  the  Block  FFQ,  the  exclusion  criteria  were  related  not  to  total  energy  intake, 
but  to  identifiable  errors  in  responses.  The  criteria  used  for  this  analysis  were  the  defauh 
edit  criteria  in  the  software,  as  follows;  skipped  more  than  15%  of  the  food  items;  omitted 
portion  size  on  100%  of  food  items  or  answered  "medium"  to  100%  of  the  food  items; 
total  number  of  solid  food  items  added  up  to  fewer  than  four  solid  foods  per  day,  or  more 
than  30;  three  or  more  different  food  items  had  frequency  responses  that  exceeded 
predefined  "reasonable"  fi^equencies.  Eleven  percent  of  Block  women  and  7%  of  Block 
children  were  flagged  as  having  questionable  data  by  these  criteria.  These  are  the  study 
subjects  excluded  fi^om  analyses  labeled  "Outlier  FFQs  Dropped,"  although  they  are  not 
strictly  outliers  but  are  questionable  for  other  reasons. 
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Editing  of  the  FFQ  Manual  Scores 

The  manual  scoring  performed  by  the  field  aides  was  reviewed  centrally  and 
corrected,  if  necessary,  prior  to  data  entry. 

Data  Quality  Issues 

Recall  Data  —  Portion  Size  Estimation 

As  can  be  seen  fi-om  the  description  of  the  data  collection  methods  and  the  data 
editing  methods  above,  attention  was  paid  to  obtaining  the  highest  quality  data  for  this 
study.  Nevertheless,  it  appears  likely  that  errors  in  the  reference  data  still  remain.  Use  of 
the  Posner  two-dimension  models  to  estimate  portion  size  may  have  been  difficult  for  this 
population.  It  appears  very  difficult  to  relate  the  two-dimensional  drawing  of  various 
bowls,  for  example,  to  actual  three-dimensional  bowls.  Of  the  two  bowl  sizes  shown,  one 
is  clearly  larger  than  the  other,  but  it  may  not  be  clear  that  the  larger  one  actually  holds 
two  cups.  Estimating  two  cups  instead  of  one  cup  for  fortified  breakfast  cereal,  for 
example,  can  produce  severe  overestimates  of  micronutrients.  The  smallest  glass  shown  is 
intended  to  represent  a  shot  glass,  and  is  rated  at  only  1.5  ounces.  However,  it  could  be, 
and  apparently  sometimes  was,  mistaken  for  a  small  four-ounce  juice  glass.  Differences 
among  the  three  sizes  of  spoons  are  difficuh  to  distinguish,  but  their  rated  amounts  range 
fi-om  two  teaspoons  to  1.8  tablespoons  (no  spoon  represents  one  teaspoon).  Similar 
difficulties  appear  to  exist  for  all  the  drawings. 

It  appeared  fi^om  examination  of  the  recall  data  that  in  some  cases  substantial 
overestimates  of  portion  size  took  place.  Underestimates  may  also  have  taken  place,  for 
example  in  thickness  of  slices  of  meat.  However,  overestimates  appear  to  be  more 
common.  This  is  supported  by  the  mean  values  seen  in  this  study.  After  the  exclusions 
described  above,  the  mean  energy  intakes  for  pregnant,  breastfeeding  and  non- 
breastfeeding  women  (2,120,  2,020  and  1,830  kcal,  respectively)  are  each  250-300  kcal 
higher  than  the  comparable  group  of  pregnant,  lactating  or  non-lactating  women  in  the 
1985-86  CSFII  data.  That  is  true  regardless  of  whether  one  examines  the  CSFII  data  for 
Whites  or  African  Americans,  above  or  below  poverty  (Murphy,  1993). 
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The  difficulty  of  estimating  portion  size  has  been  the  subject  of  considerable 
research  (Guthrie  et  al.,  1984).  Recently  some  very  relevant  research  was  conducted  by 
Kuehneman  et  al.  (1994).  These  investigators  asked  caregivers  of  young  children  to 
estimate  portion  sizes  of  foods  consumed  by  their  children,  using  three  methods; 
graduated  food  models,  Nasco  plastic  food  models,  or  food  pictures.  In  a  fourth 
approach,  standard  portions  were  assigned  to  each  food  by  the  investigators.  The 
caregivers  then  collected  weighed  duplicate  24-hour  intakes  monthly  for  one  year.  Each 
of  the  four  portion  size  estimates  were  then  compared  with  the  actual  weighed  portion  size 
consumed  for  38  food  items.  The  standard  serving  sizes  produced  many  fewer 
misestimates  of  the  portion  size  actually  consumed  than  did  any  of  the  three  visual  models 
used  by  the  caregivers.  Using  the  food  pictures,  the  portion  size  was  correctly  estimated 
for  only  six  of  the  38  foods.  In  contrast,  17  of  the  38  were  accurate  when  the  standard 
portion  was  used.  Most  misestimates  were  in  the  direction  of  overestimates;  31  of  the  38 
food  items  were  overestimated  by  the  caregivers  using  the  food  pictures. 

In  summary,  it  is  likely  that  considerable  portion  size  misestimates  and 
overestimates  existed  prior  to  editing  and  that  many  still  remain  but  are  not  detectable 

Recall  Data  -  Respondent  Characteristics 

The  subjects  in  this  study  included  low-income  Hispanic,  African-American  and 
White  women.  Educational  level  was  moderate,  particularly  among  Hispanic  women  (see 
Section  4. 1).  Lack  of  familiarity  with  the  kind  of  thinking  required  to  remember  foods  and 
estimate  portion  sizes  may  have  been  a  factor  in  this  population. 

Recall  Data  -  Database  or  Data  Collection  Problems 

As  noted  above,  there  may  be  inappropriate  nutrient  content  or  quantification 
assumptions  in  the  NDS  database,  of  which  the  calcium  content  of  Kool  Aid  is  an 
example.  Another  important  data  collection  problem  became  apparent  in  this  study, 
involving  the  collection  of  recall  data  from  Hispanics,  because  of  the  very  large  number  of 
mixed  dishes  in  the  typical  Hispanic  diet.  Approximately  80%  of  the  Hispanic  women  in 
the  study  chose  to  complete  the  FFQs  in  Spanish,  suggesting  a  close  acculturation  to  the 

WIG  Dietary  Assessment  Validation  Study 
Final  Report  -  September  22,  1994 
Page  3-31 


Hispanic  diet.  The  Hispanic  diets  involve  mixed  dishes  to  a  very  large  extent.  Even  if 
named  mixed  dishes  exist  on  the  database,  their  composition  may  differ  from  one  ethnic 
subgroup  to  another.  And  often  the  dishes  may  not  have  a  particular  name,  such  as 
"menudo,"  but  are  simply  individual  mixed  dishes.  In  this  study,  the  interviewer  obtained 
the  recipe,  including  exact  amounts  not  only  of  individual  foods  but  of  liquid,  and  more 
importantly,  ascertained  how  much  of  that  recipe  was  consumed  by  the  subject.  This  is 
inevitably  an  error-prone  process  both  on  the  part  of  the  person  reporting  the  amounts  and 
the  interviewer  recording  the  amount  consumed.  It  is  possible  that  this  error  was  one 
source  of  the  poorer  results  seen  in  the  correlations  for  Hispanics  (see  Section  4.3). 

Corresponding  Errors  in  Recall  and  FFQ  Data 

As  illustrated  in  the  correlation  results  (see  Section  4.3),  a  single  respondent 
whose  FFQ  estimate  differs  notably  from  the  recall  estimate  can,  under  some 
circumstances,  dramatically  reduce  the  correlation  coefficient  for  the  whole  group. 
However,  it  is  also  possible  to  artificially  inflate  the  observed  correlation.  This  inflation 
can  occur  when  some  study  subjects  commit  similar  errors  on  both  the  FFQ  and  reference 
data.  To  prevent  this  type  of  error,  validation  studies  are  performed  using  two  different 
types  of  data  collection,  recalls  or  records  for  the  reference  data,  and  food  frequency 
questionnaires  for  the  test  data.  However,  it  appears  possible  that  in  the  present  study 
corresponding  or  correlated  overestimation  errors  in  reference  data  and  FFQ  data  may 
have  produced  some  exaggerated  correlations.  It  may  also  be  an  explanation  for  the  lower 
correlations  seen  when  the  FFQ  outliers  were  excluded  from  the  analyses. 

Final  Data  Set  Preparation 

The  24-hour  recall  data  from  all  participants  were  converted  to  nutrient  values 
using  NDS-32  software.  Two  NDS  recall  data  sets  were  created.  One  contained  detailed 
breakdowns  of  daily  food  intake  for  each  subject  for  each  of  the  three  recalls.  The  other 
data  set  contained  the  totaled  daily  intakes  for  each  subject  for  each  recall  and  the  three- 
day  averages  for  the  nutrients  of  interest.  The  final  data  set  consisted  of  757  acceptable 
cases  with  three  recalls  per  case.    Demographic  data  and  Block  and  Harvard  FFQ  data 
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consisting  of  computer  scores,  manual  scores  and  food  group  scores  were  merged  with 
the  NDS  data.  When  all  questionable  recall  data  were  eliminated  from  analysis,  the 
resuhing  subset  of  the  data  contained  650  cases  (see  Section  4.1,  Description  of  Study 
Population). 

3.8  ANALYSIS 

The  analyses  were  performed  using  SPSS  for  Windows  (Statistical  Package  for  the 
Social  Sciences),  Release  6.0  (Norusis,  1993).  Analyses  ranged  from  simple  summary 
statistics  and  frequency  distributions  through  factorial  analyses  of  variance  designs  with 
simple  effects  tests.  Stem  and  leaf  plots  and  scatter  plots  were  used  to  identify  extreme 
values.  Pearson's  chi-square  statistics  ánd  both  Pearson  Product  Moment  and  Spearman 
correlations  were  conducted.  Repeated  measures  analysis  of  variance  between-  and 
within-group  were  performed  using  the  Biomedical  Data  Package  (BMDP)  Dynamic, 
Release  7.0  (Dixon,  1992),  to  provide  estimates  of  between-  and  within-group  variance 
components  used  in  the  correction  for  attenuation  of  correlation  coefficients  due  to 
measurement  error  in  the  reference  data. 

Bivariate  normal  data  are  required  to  satisfy  the  assumptions  of  the  Pearson  correlation 
coefficient.  Pearson  was  chosen  for  the  main  analyses  over  the  non-parametric  Spearman 
approach  for  purposes  of  performing  adjustments  for  measurement  error.  Both  FFQ  and  diet 
recall  data  were  first  examined  for  skewness  and  normality.  If  they  were  skewed  or  non- 
normal,  as  most  were,  a  transformation  was  applied.  This  was  done  as  a  separate  process  for 
each  instrument  (Harvard,  Block);  for  the  first  and  second  administrations  of  the  questionnaire 
(FFQ-1,  FFQ-2);  for  all  subjects  in  the  analyzed  core  data  set  and  for  the  subset  who  were  not 
"FFQ  outliers;"  for  all  children;  all  women;  for  each  ethnic  group;  and  for  each  WIC  category 
(pregnant,  breastfeeding,  non-breastfeeding);  and  the  respective  recall  data  for  each  of  the 
above  groups.  Each  of  these  groups  was  then  transformed  using  the  transformation  that  best 
reduced  the  skewness  and  improved  the  normality.  Log  transformation,  square  root 
transformation,  and  in  a  few  cases  no  transformation,  were  used.  This  approach  successfully 
normalized  the  data. 
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Log  transformation  is  sometimes  not  the  best  transformation  to  normalize  and 
reduce  sicewness.  Indeed,  log  transformation  may  often  increase  the  skewness  or  non- 
normality  of  the  data.  Explorations  in  the  present  study  revealed  that  correlations  were 
sometimes  higher  when  log  transformation  was  used  compared  with  the  optimal 
transformation.  However,  since  the  purpose  of  the  present  study  was  not  to  obtain  the 
best  correlation  but  the  best  estimate  of  the  true  correlation,  log  transformation  was  not 
used  unless  it  was  the  transformation  that  produced  the  most  normal,  least  skewed  data. 

Spearman  (non-parametric)  correlations  are  presented  in  these  results  for  some 
analyses.  The  Spearman  approach  produces  correlations  closely  similar  to  Pearson 
correlations  when  Pearson  correlations  have  been  performed  on  normalized  data. 
Consequently,  Spearman  correlations  are  used  when  subgroup  comparisons  are  being 
examined,  since  they  do  not  require  the  tedious  re-normalization  of  each  new  subgroup. 
However,  for  the  main  set  of  correlations  in  which  it  was  desired  to  perform  adjustments 
for  measurement  error,  Pearson  correlations  with  appropriate  transformations  were  used. 
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SECTION  4  -  RESULTS 


4.1      DESCRIPTION  OF  STUDY  POPULATION 
Analytic  Approach 

A  total  of  969  women  was  recruited  to  participate  in  the  study.   Of  these,  757 
'tompleted  their  obligation"  by  providing  all  three  days  of  diet  recalls  and  two  FFQs. 
This  'fcompleted"  sample  of  757  was  then  reduced  to  650  as  a  result  of  extensive  edits 
performed  on  the  reference  data  (the  24-hour  diet  recalls).    The  resulting  650  study 
subjects  constitute  the  core  or  'Analyzed"  data  set.  All  analyses  were  performed  on  this 
core  data  set.  This  section  describes  the  demographic  characteristics  of  the  core  data  set, 
and  demonstrates  that  there  was  balance  between  the  Harvard  and  Block  FFQs  on  the 
relevant  demographic  characteristics. 

Balance  Between  Harvard  and  Block 

Table  4-1  shows  the  distribution  of  relevant  characteristics  of  the  population,  by 
FFQ  type.  It  can  be  seen  that  balance  was  achieved  between  Harvard  and  Block  on  all 
variables  that  were  measured.  The  difference  in  education  by  ethnicity  is  notable.  For 
women  and  women  reporting  for  a  child,  approximately  one-third  of  Hispanic  participants 
reported  having  eight  years  of  education  or  less.  For  African  Americans  and  Whites,  less 
than  3%  reported  at  this  level.  A  more  detailed  education  distribution  by  ethnicity  is 
presented  in  Table  4-2. 

Balance  was  also  achieved  with  the  diet  recall  data  for  the  nutrients  of  interest 
between  the  Harvard  and  Block  women  (see  Table  4-3).  Mean  nutrient  intake  was  also 
comparable  between  the  Harvard  and  Block  children  with  the  exception  of  the  Block 
children  having  a  significantly  higher  mean  protein  intake  in  both  the  completed  and 
analyzed  data  and  a  slightly  higher  calcium  intake  in  the  analyzed  data  (p  =  .06).  Analysis 
of  variance  did  detect  significant  differences  in  nutrient  intake  by  ethnic  group  and  WIC 
category,  as  can  be  seen  by  examining  Tables  4-8  through  4-14. 
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Table  4-1 

Demographic  Characteristics  (Completed  and  Analyzed)  by  FFQ  Type 


Harvard 

Completed 

n  =  757 

Block  Significance 

Harvard 

Analyzed 

n  =  650 
Block 

Significance 

n  =  382 

n=375 

n  =329 

n  =  327 

Ethnicity  * 

African  American 

91 

96 

ns 

81 

82 

ns 

Hispanic 

87 

93 

■  lO 

71 

84 

ns 

White 

96 

85 

ns 

83 

68 

ns 

Category 

Pregnant 

93 

93 

ns 

75 

81 

ns 

Breastfeeding 

95 

Q7 

1  lo 

81 

74 

ns 

Non-breastfeeding 

86 

84 

ns 

79 

79 

ns 

Child 

108 

101 

94 

87 

ns 

Mean  Age  at  Entry 

Women 

25.3 

ns 

24.9 

25.4 

ns 

Children 

2.4 

2.5 

ns 

2.4 

2.5 

ns 

Previously  on  WIC 

in  Last  4  Weeks** 

No 

32.5% 

30.5% 

ns 

32.6% 

30.6% 

ns 

Yes 

67.5% 

69.5% 

ns 

67.4% 

69.4% 

ns 

Among  HispanicS* 

Spanish 

80.5% 

82.8% 

ns 

80.3% 

81.0% 

ns 

Enalish 

19.5% 

17.2% 

ns 

19.7% 

19.0% 

ns 

Education*** 

African  American 

ns 

ns 

0-8  Years 

0.0% 

1 .2% 

0.0% 

0.0% 

9-12  Years 

54.4% 

53.3% 

58.8% 

52.6% 

1 3+  Years 

45.6% 

45.5% 

41.3% 

47.3% 

Hispanic 

ns 

ns 

0-8  Years 

35.6% 

33.7% 

35.2% 

36.1% 

9-12  Years 

54.0% 

55.4% 

56.3% 

55.4% 

13+  Years 

10.3% 

10.9% 

8.4% 

8.4% 

White 

ns 

ns 

0-8  Years 

2.1% 

0.0% 

2.4% 

0.0% 

9-12  Years 

58.9% 

61.0% 

59.8% 

66.7% 

1 3+  Years 

39.0% 

39.0% 

37.8% 

33.3% 

ns  =  not  significant 

*  women  participants  only;  excludes  children 

**  all  women  and  children  participants 

***  women  participants  and  women  reporting  for  a  child 
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Table  4-2 

Educational  Levels  (Completed  and  Analyzed)  by  Ethnicity 


Completed 

Analyzed 

n=  757 

n  =  650 

African 

African 

American 

Hispanic 

White 

American 

Hispanic 

White 

Years  of 

n  =263 

n=252 

n=242 

n=232 

n  =214 

n  =  204 

Education* 

0 

f\  An/ 

0.0% 

1.1% 

0.0% 

0.0% 

1 .3% 

rt  AO/ 

0.0% 

1-5 

0.0% 

10.0% 

0.0% 

0.0% 

11.0% 

0.0% 

6 

0.0% 

16.8% 

0.0% 

0.0% 

16.2% 

0.0% 

7-8 

0.6% 

6.7% 

1.1% 

0.0% 

7.1% 

1.4% 

9 

2.2% 

17.9% 

4.0% 

2.6% 

19.5% 

2.0% 

10-11 

16.1% 

15.0% 

14.7% 

16.7% 

14.3% 

14.9% 

12 

35.6% 

21.8% 

41.2% 

36.5% 

22.1% 

45.9% 

13-14 

28.9% 

5.6% 

23.2% 

28.2% 

5.1% 

22.3% 

15-16 

12.8% 

2.8% 

11.3% 

13.5% 

2.5% 

10.8% 

17+ 

3.9% 

2.2% 

4.5% 

2.6% 

0.6% 

2.7% 

*  women  participants  and  women  reporting  for  a  child 
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Table  4-3 

Mean  Nutrient  Intake  (Completed  and  Analyzed)  by  FFQ  Type 


Harvard 

Completed 

n  =  757 

Block  Significance 

Harvard 

Analyzed 

n  =  650 
Block 

Significance 

Mean  Nutrient  Intake 
by  Recall  Data 

Women 

n  =  274 

n  -  07 A 
n  —  £.1 H 

n  =  235 

n  =  234 

Energy  (kcal) 

2,210 

1  203 

ns 

1,994 

1,994 

ns 

Prntpin  (ci\ 

89.8 

89  1 

1  rO 

79.6 

79.6 

ns 

Vitamin  A  ÍRE^ 

V  ILCII  1  III  1   /  \   11  i 

1,293 

1  ?17 

882 

896 

ns 

\/itamin  Cl  (mn\ 

V  liCII  1  III  1          1 1 1  lU^ 

198 

161 

125 

1 17 

ns 

Iron  imn^ 

II  \Jt  1  yi  1  1  U  1 

17.3 

17  3 

1  1  .w 

14.5 

14.3 

ns 

Calcium  ima^ 

N^UI  Wl  U  III    11  1  1  U  I 

1,059 

1,030 

ns 

876 

893 

ns 

Children 

n  =  108 

n  =  101 

n  =  94 

n  =  87 

Energy  (kcal) 

1,334 

1,454 

ns 

1,259 

1,344 

ns 

Protein  (g) 

50.6 

57.1 

p  <  .01 

47.5 

52.0 

p  =  .04 

Vitamin  A  (RE) 

753 

702 

ns 

636 

600 

ns 

Vitamin  C  (mg) 

125 

160 

ns 

76 

81 

ns 

Iron  (mg) 

11.7 

11.4 

ns 

10.2 

10.3 

ns 

Calcium  (mg) 

888 

893 

ns 

682 

756 

ns 

ns  =  not  significant 
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4.2      FFQ  ASSISTANCE  SCORES,  ERRORS,  COMPLETION  TIME, 
AND  SCORING  TIME 


Analytic  Approach 

The  Harvard  and  Block  FFQs  were  compared  with  respect  to  the  following  factors 
that  might  affect  the  usability  of  the  instruments  by  either  study  subjects  or  WIC 
personnel: 

•  Amount  of  assistance  needed  by  the  respondent  to  complete  the  FFQ; 

•  Number  of  errors  on  the  FFQ,  as  identified  by  manual  and  computer  edit 
procedures; 

•  Time  required  by  study  subjects  to  complete  the  FFQ;  and 

•  Time  required  by  aides  to  manually  score  the  FFQ. 


The  level  of  assistance  study  subjects  required  was  scored  as  follows: 
Score  Description 

1  =  None        Required  neither  clarifications  nor  explanations  and 

no  additional  assistance  after  the  initial  instructions 

2  =  Little        Required  1-2  clarifications  but  no  explanations 

3  =  Some        Required  3-5  clarifications  and  1-2  explanations 

4  =  Much        Required  3  or  more  explanations. 


Discussion 

Assistance  Required 

The  first  administration  of  the  FFQs  was  considered  to  be  the  most  relevant  to  the 
WIC  situation.  Average  scores  are  provided  for  this  administration  only.  Most  study 
subjects  required  relatively  little  assistance  in  completing  either  FFQ.  The  average  score 
was  less  than  2,  meaning  that,  in  general,  study  subjects  needed  little  assistance  fi-om  the 
field  aides  (see  Table  4-4).  There  was  no  difference  between  Harvard  and  Block  on  this 
variable,  by  Analysis  of  Variance.  There  were,  however,  significant  ethnic  differences, 
with  White  women  requiring  somewhat  less  assistance  than  African-American  or  Hispanic 
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women.  Although  significant,  the  differences  did  not  appear  to  be  very  important  (mean 
score  of  1.5  V5.  2.0,  for  example).  Overall,  women  completing  FFQs  for  their  children's 
diets  had  a  slightly  higher  assistance  score,  mean  =  2.0  instead  of  1.8. 

Errors  by  Respondent 

Manual  edits  identified  missing  responses  or  double-marks.  For  these  edits,  an 
error  was  counted  in  three  fields  (fi^equency,  portion  size  and  vitamin  supplement)  for  the 
Block  FFQ,  and  one  field  (fi-equency)  for  the  Harvard  FFQ.  Number  of  errors  was  totaled 
for  the  first  administration  of  the  quéstionnaire  only.  These  unadjusted  counts  (Table  4-5) 
show  statistically  significant  differences  between  Harvard  and  Block  in  mean  number  of 
errors  committed.  For  All  Women,  the  median  number  of  errors  was  2.0  for  both  Harvard 
and  Block,  but  the  mean  was  higher  for  the  Block  FFQ  (7.3  vs.  4.6).  For  most  groups  the 
median  number  of  errors  was  modest,  indicating  that  most  people  skipped  or  double- 
marked  few  or  no  food  items.  Hispanic  women,  however,  were  substantially  more  error- 
prone  than  the  other  groups,  a  difference  statistically  significant  by  analysis  of  variance. 
Women  completing  the  FFQs  for  their  children  had  a  higher  error  rate  by  this  measure, 
mean  =  7.9  instead  of  6.0  (data  not  shown). 

The  unadjusted  error  counts  do  not  provide  a  direct  comparison  between  Harvard 
and  Block  for  two  reasons.  The  error  proneness  of  Harvard  compared  to  Block  is 
exaggerated  because  the  Harvard  list  includes  more  line  items  on  which  a  respondent 
could  make  an  error.  The  Harvard  food  list  has  80  items  while  there  are  only  65  on  the 
Block  list  (62  for  children).  Conversely,  the  errors  on  Block  compared  to  Harvard  are 
exaggerated  because  omissions  on  the  Block  questionnaire  were  counted  in  three  fields 
compared  to  one  field  for  the  Harvard  questionnaire.  Omissions  of  some  portion  size 
responses  on  the  Block  FFQ  are  unimportant,  either  because  portion  size  is  not  required  if 
the  person  does  not  eat  the  food,  or  because  the  Block  computer  software  will 
automatically  default  to  a  'hiedium"  portion  size  An  examination  of  a  sample  of  Block 
questionnaires  suggested  that  approximately  one-third  of  all  errors  were  actually  omissions 
or  double-marks  in  the  frequency  field.  (Further,  approximately  one-third  of  those  were 
found  upon  query  to  be  foods  the  respondent  never  ate,  and  thus  their  omission  would 
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Table  4-4 

Assistance  Required  by  Women  Participants 

by  All  Women,  Ethnicity  and  Children 

Average  Scores,  w/iere;  1  ■ 

=  None;  2  =  Little;  3  = 

Some;  4  =  Much 

Harvard  | 

Block 

All  Women  * 

mean 

1.8 

1.9 

SD 

1  0 

1.1 

(n) 

(253) 

(241) 

African  American 

mean 

2.0 

2.1 

SD 

1.1 

1.2 

(n) 

(85) 

(92) 

Hispanic 

mean 

1.9 

2.0 

SD 

0.9 

1.2 

(n) 

(72) 

(68) 

White 

mean 

1.5 

1.6 

SD 

0.9 

0.9 

(n) 

(96) 

(81) 

Children 

mean 

1.9 

2.0 

SD 

1.1 

1.1 

(n) 

(103) 

(91) 

*  Difference  between  FFQ  types  is  not  significant  (p  =  0.36), 

difference  among  ethnic  groups  is  significant,  p  <  0.01  (ANOVA). 
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Table  4-5 

Number  of  Errors  identified  by  IVIanual  Edit 

by  All  Women  and  Ethnicity 

Includes  missing  or  double-marked  responses  for 

portion  size,  frequency  or  vitamin  supplement  fields 

Harvard 

Block 

All  Women  * 

median 

2.0 

2.0 

mean 

4.6 

7.3 

SD 

9.9 

14.0 

(n) 

(273) 

(273) 

African  American 

median 

2.0 

3.0 

mean 

4.9 

7.7 

SD 

9.2 

16.2 

(n) 

(90) 

(96) 

Hispanic 

median 

4.0 

4.0 

mean 

6.0 

10.8 

SD 

8.7 

15.8 

(n) 

(87) 

(92) 

White 

median 

0.0 

1.0 

mean 

3.1 

3.1 

SD 

11.3 

6.1 

(n) 

(96) 

(85) 

•  Statistically  significant  effects  by  both  FFQ  type,  p  <  0.02, 

and  ethnicity,  p 

<  0.01  (Analysis  of  Variance). 
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have  no  effect  on  the  nutrient  estimates.)   Adjustment  of  the  error  scores  of  the  two 
instruments  to  account  for  the  'bvercounting"  in  each  direction  suggests  that  there  is  no 
difference  between  the  instruments  in  the  number  of  relevant  items  that  study  subjects 
omitted  or  double-counted 

A  computerized  edit  of  omitted  or  double-marked  food  frequency  items  remaining 
after  the  FFQs  were  examined  by  the  aides  found  1 7%  of  Harvard  women's  FFQs- 1  had 
one  or  more  skipped  items  remaining,  and  9%  of  Block  women's  FFQs-1  had  one  or  more 
skipped  items  remaining.  None  of  the  FFQs  had  more  than  a  few  missed  items,  and 
neither  instrument  had  a  sufficiently  large  number  of  remaining  skipped  or  double-marked 
items  to  be  considered  a  serious  source  of  error. 

Time  for  Study  Subjects  to  Complete  the  FFQs 

This  is  shown  only  for  the  second  administration  (FFQ-2),  since  few  study  subjects 
were  timed  during  the  first  administration  due  to  the  logistic  complexities  of  the  first 
phase.  Table  4-6  shows  that  both  types  of  FFQs  were  completed  in  less  than  10  minutes 
by  both  African- American  and  White  study  subjects,  and  in  less  than  15  minutes  by 
Hispanic  study  subjects.  Study  subjects  took  longer  to  complete  the  Block  FFQ  than  the 
Harvard  FFQ  with  a  median  time  of  9  5  minutes  for  Block  vs.  8  minutes  for  Harvard  for 
All  Women  (means  of  11.0  vs.  8.6  minutes)  Both  the  FFQ  type  and  ethnic  differences 
were  statistically  significant  by  Analysis  of  Variance.  Completion  time  for  mothers 
responding  for  their  children  was  similar  to  All  Women  (data  not  shown),  but  the  numbers 
were  too  small  to  derive  any  firm  conclusions. 

Time  for  Aide  to  Manually  Score  the  FFQs 

There  were  no  significant  differences  between  Harvard  and  Block  in  the  time 
required  for  scoring  (Table  4-7).  The  median  time  was  three  minutes  for  both  instruments 
at  both  time  periods.  Between  the  first  and  second  time  periods  (FFQ- 1  and  FFQ-2),  the 
additional  practice  resulted  in  a  lower  scoring  time  for  both  FFQs.  The  improvement  was 
slightly  greater  for  the  Harvard  manual  scoring,  from  a  mean  of  3  .9  minutes  for  FFQ-1  to 
3.2  minutes  for  FFQ-2.  The  Harvard  scoring  system  possibly  was  somewhat  intimidating 
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or  confusing  to  aides  at  first,  but  with  familiarity,  it  became  very  rapid  and  easier  to  score 
than  Block.  The  reason  may  be  due  to  the  mental  mathematical  additions  required  of  the 
Block  scoring  system.  Aides  took  slightly  longer  to  score  children's  FFQs  (mean  3  6 
minutes  for  FFQ-2  instead  of  3.3  minutes  for  women's  FFQs;  data  not  shown). 

As  would  be  expected,  the  amount  of  assistance  required,  number  of  errors 
committed  and  aides'  scoring  time  were  reduced  at  the  second  administration  of  the  FFQs. 


Table  4-6 

Time  for  Respondent  to  Complete  FFQ-2 

by  All  Women  and  Ethnicity 

(in  minutes) 

Harvard 

Block 

All  Women  *  median 

8.0 

9.5 

mean 

8.6 

11.0 

SD 

3.4 

5.0 

(n) 

(61) 

(58) 

African  American  median 

8.0 

9.0 

mean 

8.5 

8.9 

SD 

3.1 

2.3 

(n) 

(20) 

(17) 

Hispanic  median 

10.5 

13.5 

mean 

10.3 

14.6 

SD 

3.9 

6.0 

(n) 

(24) 

(22) 

White  median 

6.0 

8.0 

mean 

6.4 

8.5 

SD 

1.0 

2.7 

(n) 

(17) 

(19) 

•  Statistically  significant  effects  by  both  FFQ  type  and  ethnicity, 

Analysis  of  Variance  p  <  0.01 
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Table  4-7 

Time  to  Score  FFQ-1  and  FFQ-2 
by  Type  of  FFQ 

(in  minutes) 


Harvard  | 

Block 

median 

3.0 

3.0 

mean 

3.9 

3.8 

SD 

2.0 

1.5 

(n) 

(266) 

(259) 

FFQ-2  median 
mean 
SD 
(n) 


3.0 

3.2 
0.9 

(236) 


3.0 

3.4 
1.0 
(234) 


*  By  ANOVA,  a  significant  ethnicity  effect  exists  for  FFQ-1  (p<0.01) 
and  FFQ-2  (p<0.05)  controlling  for  Harvard,  Block  instrument  types. 
The  effect  is  greatest  for  Hispanic  FFQs,  with  the  highest  score 
time,  followed  by  African-American  then  by  White  FFQs. 


4.3  FFQ  VALIDITY  CORRELATIONS 
Analytic  Approach 

A  central  purpose  of  FFQs,  both  for  research  and  for  WIC  purposes,  is  to  place 
individuals  along  a  distribution  of  intake  from  low  to  high.  Accuracy  of  the  point  estimates 
(group  means),  while  useful  for  some  purposes,  provides  no  test  whatsoever  of  the  ability  of  an 
instrument  to  determine  correctly  whether  an  individual's  intake  is  high  or  low.  FFQ  group 
means  can  be  identical  to  diet  recall  group  means  despite  providing  zero  ability  to  rank 
individuals;  and  conversely,  FFQ  group  means  can  be  significantly  lower  than  diet  recall  means, 
but  the  FFQ  can  rank  individuals  well  (Sobell  1989,  Stuff  1983).  To  be  relevant  for  estimating 
whether  an  individual  is  at  increased  nutritional  risk,  a  proposed  FFQ  must  produce  adequate 
correlations  with  reference  data.  It  is  correlation  that  forms  the  criterion  for  whether  an 
instrument  can  provide  a  reasonably  accurate  estimate  of  an  individual's  location  along  the 
distribution  from  low  to  high  intake. 
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This  section  presents  the  correlations  between  the  FFQ  nutrient  estimates  and  the 
reference  data  estimated  from  three  non-consecutive  days  of  diet  recalls.  Data  are  presented 
only  for  nutrients  from  food;  mineral  and  vitamin  supplement  intake  is  not  included. 

The  correlations  for  the  core  analyzed  data  (n  =  650)  with  no  nutrient/energy  outlier 
FFQs  excluded  and  for  the  subset  of  cases  with  FFQ  outliers  excluded  are  shown  for  the  first 
and  second  FFQ  administration  separately.  These  data  are  shown,  unadjusted,  in  Tables  4-8 
(for  FFQ-1)  and  4-9  (for  FFQ-2). 

Adjustments  to  account  for  error  in  the  reference  data,  the  diet  recalls,  were  performed 
according  to  the  method  described  by  Beaton  (1979),  Liu  (1978),  Rosner  (1988).  The  dietary 
intake  based  on  three  days  does  not  perfectly  reflect  'true"  usual  intake  over  a  longer  period, 
because  of  day-to-day  variability.  Consequently,  any  correlation  between  this  imperfect 
measure  of  intake  and  a  food  frequency  questionnaire  is  an  underestimate  of  the  true 
correlation  However,  the  intraindividual  variability  in  intake  and  its  relationship  to 
interindividual  variability  can  be  quantified  by  means  of  analysis  of  variance  of  the  three  diet 
recalls,  and  the  results  used  to  adjust  the  observed  correlations.  The  adjustment  factors,  when 
applied  to  the  observed  correlations,  result  in  the  adjusted  correlations  being  higher  than  the 
unadjusted  correlations.  These  adjusted  correlations  are  shown  in  Appendix  D,  Tables  D-1 
(for  FFQ-1)  and  D-2  (for  FFQ-2).  These  adjusted  correlations  are  not  emphasized  in  the 
discussion  because  they  are  themselves  estimates  based  on  imperfect  data.  They  do  not  alter 
any  conclusions  about  the  relative  value  of  the  two  FFQs.  They  do  provide  a  general  sense  of 
the  magnitude  of  the  improvement  which  might  have  been  seen  had  'kll"  days  of  dietary 
reference  data  been  collected,  instead  of  only  three  days. 

Statistical  Significance 

The  statistical  significance  of  a  correlation  coeflBcient  (that  is,  whether  or  not  it  is 
significantly  different  from  zero)  is  simply  a  fianction  of  the  sample  size.  For  the  All  Women 
analyses,  correlations  as  low  as  r  =  0. 13  will  be  significant  at  the  p  <  0.05  level.  For  other 
subgroups  (pregnant,  Hispanic,  etc.),  correlations  as  low  as  approximately  r  =  0.22  will  be 
significant  at  the  0.05  level.  Significance  is  not  emphasized  because  it  is  self-evident  from  the 
above  data,  and  it  tells  little  about  the  usefijlness  of  the  relationship.  For  purposes  of  this 
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Table  4-8  Validity  Coefficients  for  Harvard  and  Block  FFQ-1 

All  Cases  Included 

Outliers  Dropped 

rial  Val  U 

DiOCII 

rial  val  u 

Block 

African  American 

Enerqv 

0.18 

0.53 

0.12 

0.37 

Protein 

0.22 

0.46 

0.08 

0.35 

Vitamin  A 

U.UU 

yj.Zo 

U.Ul 

\J.\0 

Vitamin  C 

-0.36 

0.32 

-0.23 

0.29 

Iron 

0.02 

0.40 

0.02 

0.20 

Calcium 

0.27 

0.46 

0.38 

0.40 

Hispanic 

Enera  V 

0.19 

0.14 

0.08 

0.07 

Protein 

0.13 

0.09 

0.10 

0.00 

Vitamin  A 

0.4Ü 

Ü.  10 

n  yin 

Vitamin  C 

0.28 

0.17 

0.18 

0.14 

Iron 

0.28 

-0.01 

-0.03 

-0.13 

Calcium 

0.18 

0.15 

0.13 

0.17 

White 

Enerov 

0.27 

0.44 

0.29 

0.48 

Protein 

0.33 

0.53 

0.38 

0.55 

Vitamin  A 

n  Oil 

n  fio 
u.o^ 

n 

u.oo 

Vitamin  C 

0.33 

0.20 

0.31 

0.13 

Iron 

0.27 

0.47 

0.32 

0.40 

Calcium 

0.40 

0.56 

0.43 

0.51 

Ail  Women 

Energy 

0.19 

0.37 

0.16 

0.31 

Protein 

0.24 

0.35 

0.21 

0.27 

Vitamin  A 

U.^  1 

n  in 

Vitamin  C 

0.13 

0.30 

0.12 

0.24 

Iron 

0.20 

0.26 

0.11 

0.12 

Calcium 

0.29 

0.42 

0.34 

0.36 

Pregnant 

Energy 

0.22 

0.30 

0.20 

0.21 

Protein 

0.29 

0.32 

0.24 

0.28 

Vitamin  A 

Vitamin  C 

0.12 

0.18 

0.08 

0.11 

Iron 

0.32 

0.05 

0.31 

-0.07 

Calcium 

0.41 

0.37 

0.47 

0.28 

Breastfeeding 

Energy 

0.23 

0.25 

0.13 

0.19 

Protein 

0.18 

0.22 

0.13 

0.10 

Vitamin  A 

n  9^ 
u.^o 

n  OA 

n  Oft 

Vitamin  C 

0.05 

0.22 

0.03 

0.12 

Iron 

0.06 

0.28 

-0.25 

0.19 

Calcium 

0.17 

0.31 

0.24 

0.28 

Non-breastfeeding 

Energy 

0.14 

0.48 

0.14 

0.45 

Protein 

0.18 

0.44 

0.16 

0.37 

Vitamin  A 

0.09 

0.38 

0.00 

0.29 

Vitamin  C 

0.17 

0.38 

0.20 

0.39 

Iron 

0.20 

0.37 

0.20 

0.23 

Calcium 

0.23 

0.43 

0.19 

0.36 

Children 

Energy 

0.13 

0.14 

0.23 

0.10 

Protein 

0.19 

0.15 

0.31 

0.03 

Vitamin  A 

0.28 

0.03 

0.30 

0.07 

Vitamin  C 

0.10 

0.19 

0.19 

0.29 

Iron 

0.01 

0.15 

0.05 

0.20 

Calcium 

0.27 

0.04 

0.23 

0.04 
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Table  4-9  Validity  Coefficients  for  Harvard  and  Block  FFQ-2 

All  Cases  Included 

Outliers  Dropped 

■  ml  va  lu 

Block 

nci  1  va  ■  u 

Block 

Africa  n-Ame  rica  n 

Energy 

0.31 

0.41 

0.45 

0.44 

Protein 

0.20 

0.43 

0.33 

0.46 

Vitamin  A 

0.17 

0.17 

0.29 

0.07 

Vitamin  C 

nil 

u.oo 

U.  I*r 

n 

u.o/ 

Iron 

0.15 

0.43 

0.28 

0.47 

Calcium 

0.35 

0.46 

0.56 

0.54 

Hispanic 

Energy 

0.16 

0.13 

0.12 

0.06 

Protein 

0.15 

0.12 

0.14 

0.09 

Vitamin  A 

0.33 

0.07 

0.30 

0.03 

Vitamin  C 

U.ZD 

U.O  1 

u.oz 

Iron 

0.34 

0.04 

0.11 

0.07 

Calcium 

0.18 

0.29 

0.15 

0.18 

White 

Energy 

0  36 

0.42 

0.41 

0.40 

Protein 

0  32 

0.47 

0.36 

0.46 

Vitamin  A 

0.27 

0.61 

0.31 

0.52 

Vitamin  C 

\J.*T<J 

0  49 

Iron 

0.25 

0.51 

0.26 

0.51 

Calcium 

0.46 

0.51 

0.54 

0.43 

All  Women 

Energy 

0.24 

0.31 

0.33 

0.31 

Protein 

0.22 

0.33 

0.29 

0.34 

Vitamin  A 

0.23 

0.23 

0.26 

0.17 

Vitamin  C 

0.33 

0.36 

0.33 

0.35 

Iron 

0.25 

0.30 

0.21 

0.33 

Calcium 

032 

0.45 

0.48 

0.41 

Pregnant 

Energy 

0.18 

0.24 

0.44 

0.34 

Protein 

0.22 

0.31 

0.39 

0.42 

Vitamin  A 

0  16 

0.25 

0.24 

0.35 

Vitamin  C 

n  17 

n  Tí 

Iron 

0  18 

0.19 

0.29 

0.37 

Calcium 

0.22 

0.36 

0.43 

0.37 

Breastfeeding 

Energy 

0.31 

0.29 

0.35 

0.32 

Protein 

0.20 

0.21 

0.31 

0.26 

Vitamin  A 

026 

0.25 

0.24 

0.16 

Vitamin  C 

n  XT 

iron 

0.26 

0.38 

0.07 

0.43 

Calcium 

0  33 

0.34 

0.48 

0.28 

Non-breastfeeding 

Energy 

0  14 

0.33 

0.17 

0.24 

Protein 

0  16 

0.40 

0.11 

0.32 

Vitamin  A 

0.19 

0.16 

0.19 

-0.05 

Vitamin  C 

025 

0.40 

0.16 

0.36 

Iron 

0.23 

0.27 

0.19 

0.14 

Calcium 

0.34 

0.48 

0.35 

0.45 

Children 

Energy 

0.15 

0.33 

0.29 

0.31 

Protein 

0.22 

0.27 

0.35 

0.15 

Vitamin  A 

0.29 

0.08 

0.21 

0.09 

Vitamin  C 

0.18 

0.22 

0.20 

0.33 

Iron 

0.08 

0.26 

0.16 

0.39 

Calcium 

0.29 

0.20 

0.28 

0.20 
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discussion,  correlations  lower  than  0.4  are  deemed  to  indicate  a  relationship  too  weak  to  be 
useful. 

In  addition,  the  correlations  achieved  by  the  Harvard  and  Block  instruments  were 
tested  to  determine  whether  they  were  statistically  different  from  each  other  (Kleinbaum  1982) 
This  is  a  stringent  test;  for  All  Women  (core  analyzed  data  with  no  FFQs  dropped)  correlations 
for  the  two  FPQs  would  have  to  differ  by  more  than  0. 18,  and  for  the  subgroups  they  would 
have  to  diflfer  by  approximately  0.32  or  more  to  be  significantly  different. 

It  is  of  interest  to  compare  the  two  FFQs  when  identical  edit  criteria  are  used.  The 
Harvard  FFQ  has  a  single  outlier  criterion  of  '^eater  than  4,500  kcal."  When  this  energy 
criterion  is  applied  to  the  Block  FFQs  in  this  study,  only  eight  Block  FFQs  would  exceed  4,500 
kcal.  Thus,  a  comparison  of  Harvard  (outliers  dropped)  with  Block  (no  outliers  dropped) 
approximates  a  comparison  using  identical  criteria.  This  is  only  an  approximation  because  the 
eight  Block  cases  >  4,500  kcal  remained  in  the  Block  data. 

Consequently,  several  sets  of  comparisons  are  possible: 

•  the  two  FFQs,  v^th  all  core  participants  included  (n  =  650); 

•  the  two  FFQs,  after  dropping  their  respective  'butliers"  based  on  the 
separate  edit  criteria;  and 

•  the  two  FFQs,  using  comparable  energy  edit  criteria  (i.e..  Harvard  FFQ 
outliers  dropped  V5.  no  Block  FFQ  outliers  dropped). 

Validity  Correlation  Results 

v^propriateness  of  Using  FFQ-1 

For  most  of  the  analyses  presented  in  this  section,  emphasis  is  placed  on  the  results 
involving  the  first  administration  of  the  FFQ.  This  is  appropriate  for  several  reasons.  The 
second  FFQ  took  place  after  a  month  of  repeated  focus  on  that  person's  dietary  intake,  and 
after  a  prior  administration  of  the  same  FFQ.  Repeated  administration  involves  a  learning 
experience  on  the  part  of  the  respondent,  a  learning  experience  that  unquestionably  alters  the 
respondent's  ability  to  complete  the  questionnaire.  This  learning  experience  is  not 
representative  of  the  probable  WIC  situation.    It  is  important  for  FNS  to  assess  the 
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performance  of  the  FFQs  when  they  are  administered  by  a  naive  respondent.  For  this  purpose, 
the  first  FFQ  is  considered  to  be  the  more  appropriate  administration  for  validity  testing. 

Use  of  FFQ-2  for  Validity 

For  purposes  of  abstract  'Validity,"  it  is  also  appropriate  to  consider  the  correlations 
associated  with  the  second  FFQ  administration,  since  it  corresponds  to  the  time  period  during 
which  the  reference  data  were  collected.  Consequently,  the  second  as  well  as  the  first  FFQ 
correlations  are  shown  in  this  report.  It  is  likely  that  to  a  considerable  extent  the  dietary  intake 
of  the  study  population  did  not  differ  substantially  fi-om  the  prior  month,  since  approximately 
two-thirds  of  the  subjects  had  been  on  WIC  in  the  month  prior  to  their  entry  into  the  study. 

Averaging  of  FFQ- 1  and  FFQ-2 

Also  performed  were  correlations  for  the  nutrient  estimates  averaged  over  the  first  and 
second  administrations.  This  approach,  shown  only  in  the  Appendix,  is  a  widely  accepted 
method  that,  like  averaging  multiple  days  of  diet  records,  reduces  the  error  variability 
associated  with  a  single  administration,  and  yields  a  correlation  estimate  closer  to  the  'true" 
abstract  correlation  of  the  instrument  with  the  reference  data. 

"No  Outliers  Dropped" 

Comparisons  of  data  with  all  study  subjects  included  (no  outüer  FFQs  dropped) 
provides  a  realistic  picture  of  the  quality  of  the  data  which  would  be  presented  to  a  WIC 
nutritionist  examining  the  responses  to  the  completed  questionnaire,  food  servings,  etc. 
For  both  Harvard  and  Block,  identification  of  truly  suspect  questionnaires  occurs  only 
after  computerized  FFQ  analysis  (although  limited  visual  editing  can  identify  some 
questionable  responses).  Thus,  examination  of  'ho  outliers  dropped"  is  essential  for  an 
evaluation  of  the  real-world  usability  of  the  instruments. 

Comparisons  of  data  with  questionable  study  subjects  excluded  ('butlier  FFQs 
dropped')  provides  a  picture  of  the  data  quality  possible  after  computerized  edits  have 
identified  probable  erroneous  questionnaires.  This  examination  is  usefiil  in  assessing  the 
value  of  the  instruments  for  the  identifiable  subset  of  '^ood"  questionnaires,  and  their 
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value  for  other  uses  such  as  investigating  changes  over  time  or  comparisons  of  aggregate 
data  within  or  across  WIC  regions. 

Supplements 

Vitamin  and  mineral  supplement  use  was  also  obtained  in  both  the  diet  recall  data  and 
the  Block  FFQ  (but  not  the  Harvard  FFQ).  Correlations  including  supplements  are  not 
presented  in  this  report  because  of  FNS'  emphasis  on  foods.  Without  inclusion  of  nutrients 
obtained  from  supplements,  it  is  possible  to  evaluate  the  performance  of  the  FFQs  among 
persons  who  do  not  take  supplements.  However,  two-thirds  of  the  WIC  population  did  take 
supplements,  and  supplement  sources  comprise  a  significant  component  of  their  nutrient  intake. 
At  some  future  time  it  may  be  valuable  to  investigate  the  performance  of  FFQs  in  assessing 
total  nutrient  intake. 

Results  for  First  FFQ  Administration 

In  comparing  results  for  the  three  ethnic  groups  (Afiican  American,  Hispanic,  White), 
moderately  acceptable  correlations  are  seen  for  the  Block  FFQ  among  Afiican  Americans  and 
Whites.  Neither  FFQ  performed  well  among  Hispanics.  The  modest  to  poor  correlations  seen 
for  All  Women  are  a  reflection  of  the  fact  that  one-third  of  the  sample  was  Hispanic  women, 
who  did  poorly.  Similarly,  modest  correlations  by  WIC  category  (pregnant,  breastfeeding, 
non-breastfeeding)  also  reflect  the  inclusion  of  Hispanics  in  the  sample.  Results  just  among 
Afiican  Americans  and  Whites  are  discussed  below. 

Harvard  v.y.  Block  FFQs  flSio  FFQ  Outliers  Dropped) 

For  the  groups  shown  in  Table  4-8,  "All  Cases  Included,"  the  Block  FFQ  achieved  a 
higher  correlation  in  35  of  the  groups,  and  the  Harvard  FFQ  achieved  a  higher  correlation  in  13 
of  the  groups.  In  Block,  13  correlations  were  equal  to  or  higher  than  r  =  0.40;  in  Harvard, 
three  correlations  were  equal  to  or  higher  than  0.40.  The  Block  instrument  performed  better 
than  Harvard  for  Whites  and  Afiican  Americans.  Of  the  12  such  comparisons  for  Whites  and 
Afiican  Americans,  the  Block  FFQ  achieved  nine  correlations  equal  to  or  greater  than  0.40 
Although  Harvard  performed  better  than  Block  among  Hispanics,  almost  all  the  correlations 
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were  poor.  Only  one  of  the  six  Harvard  correlations  in  Hispanics  equaled  or  exceeded  0.40.  In 
terms  of  the  statistical  significance  of  the  difference  in  the  correlations  achieved  by  the  two 
instruments,  only  five  comparisons  achieve  significance  (non-breastfeeding  Energy,  Afiican- 
American  Energy,  Afiican-American  Vitamin  C,  Afiican-American  Iron,  White  Vitamin  A), 
and,  in  all  cases,  it  is  the  Block  instrument  that  is  higher.  The  difference  between  Harvard  and 
Block  correlations  for  energy  among  All  Women  approaches  significance  (p  =  0.052  when 
significance  is  p  <  0.05)  with  Block  correlating  higher  than  Harvard,  r  =  0.37  (Block)  vs. 
r  =  0.19  (Harvard). 

By  WIC  category  (pregnant,  breastfeeding,  non-breastfeeding),  15  of  the  18 
correlations  were  higher  by  the  Block  FFQ  than  the  Harvard  FFQ.  With  few  exceptions  these 
correlations  were  modest.  As  noted  above,  to  some  extent  the  modest  correlations  by  WIC 
category  reflect  the  presence  of  Hispanics  as  one-third  of  each  group.  This  is  discussed  further 
in  the  discussion  of  ethnic  comparisons  below. 

For  children's  results,  Block  produced  higher  correlations  than  Harvard  for  three 
nutrients,  and  Harvard  was  higher  than  Block  for  three  nutrients.  All  results  for  both 
instruments  were  extremely  poor,  the  highest  being  0.27  in  FFQ-1  (Harvard  calcium)  and  0.33 
in  FFQ-2  (Block  energy). 

Outliers  or  Questionable  Responders  Excluded  (Outliers  Dropped) 

The  results  are  similar  when  the  correlations  are  examined  after  the  exclusion  of 
outliers  (see  Table  4-8,  'Outliers  Dropped').  Although  most  of  the  observed  differences  are 
minor  in  magnitude,  34  are  higher  in  Block  and  14  are  higher  in  Harvard. 

With  few  exceptions,  the  FFQ-1  correlations  are  poorer  after  the  exclusion  of  outliers, 
for  both  Harvard  and  Block.  This  is  different  fi"om  what  has  been  seen  in  other  studies  (Block 
1990a,  1992).  There  are  several  possible  explanations.  First,  the  lack  of  improvement  in 
correlations  after  FFQ  errors  are  excluded  suggests  that  errors  may  be  occurring  extensively  in 
the  reference  data,  not  excludable  by  FFQ  exclusion  criteria.  Further,  the  fact  that  correlations 
are  worse  after  exclusion  of  FFQ  errors  suggests  that  some  good  correlations  may  be  the  result 
of  similar  errors  in  the  FFQ  and  diet  recall  data.  That  is,  the  kinds  of  errors  screened  out  by 
both  sets  of  FFQ  edit  criteria  tend  to  be  errors  of  exaggeration,  such  as,  caloric  estimates  too 
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high,  or  individual  foods  improbably  high.  Similarly,  in  the  diet  recall  data,  a  tendency  was 
observed  for  some  study  subjects  to  provide  improbably  high  estimates,  resulting  in  this  case 
not  from  erroneous  frequency  but  from  erroneously  large  portion  sizes.  These  errors,  when 
left  in,  would  tend  to  artificially  increase  the  range  and  slope  of  the  nutrient  estimates.  The 
exclusion  of  these  two  conjoint  errors,  erroneously  high  estimates  on  both  test  and  reference 
methods,  would  tend  to  increase  the  apparent  agreement  between  the  two  methods.  Exclusion 
of  those  erroneously  high  values  would  tend  to  reduce  the  correlations,  as  was  seen  in  these 
results. 

Approximately  Equal  Exclusion  Criteria,  >4500  kcal  (Harvard  Outliers  Dropped  vs.  Block  All 
Cases  Included) 

Block  with  all  cases  included  had  higher  correlations  in  35  of  the  48  comparisons, 
while  Harvard  with  outliers  dropped  had  higher  correlations  in  13  of  the  comparisons. 
Thirteen  of  the  Block  correlations  were  0.40  or  greater;  two  of  the  Harvard  correlations  were 
0.40  or  greater.  Thus,  it  appears  that  overall,  the  Block  instrument  without  any  exclusions 
performed  better  than  the  Harvard  instrument  with  approximately  13%  of  study  subjects 
excluded  due  to  high  caloric  intake  alone. 

Analyses  by  Ethnic  Subgroup 

Because  the  correlations  among  Hispanic  women  were  the  poorest  of  the  three  ethnic 
groups,  analyses  were  carried  out  to  investigate  the  role  of  ethnicity  in  the  correlations  seen  in 
each  of  the  WIC  categories  (pregnant,  breastfeeding,  non-breastfeeding,  children;  data  not 
shown).  It  was  thought  that  correlations  might  be  higher  in  some  of  these  groups  if  only 
Afiican- American  (AA)  or  White  (W)  study  subjects  were  considered.  This  combined  group  is 
referred  to  as  "AA-W"  below. 

Block.  Of  18  category-nutrient  correlations  examined  among  women  (6  nutrients  x  3 
WIC  categories,  for  example,  'fenergy  among  pregnant  women'),  14  were  higher  when  only 
AA-W  women  were  included  than  when  all  three  ethnic  groups  were  included. 
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Harvard  Nine  of  the  18  correlations  were  higher  when  Hispanics  were  excluded,  and 
9  were  the  same  or  lower.  In  particular,  the  Harvard  correlations  were  higher  for  Hispanics 
than  for  African  Americans  or  Whites  in  vitamin  A  and  vitamin  C. 

Block  vs.  Harvard.  When  correlations  just  among  AA-W  are  considered  for  the  three 
WIC  categories.  Block  results  are  higher  than  Harvard's  in  14  of  18  group-nutrient 
correlations.  When  correlations  just  among  Hispanic  women  are  considered.  Harvard  results 
are  higher  than  Block's  in  14  of  18  comparisons.  The  higher  correlations  among  Hispanics  are 
the  sources  of  the  higher  Harvard  correlations  among  pregnant  women  for  vitamin  A  and 
calcium  in  Table  4-8. 

It  would  appear  that  among  AA-W  women,  the  Block  instrument  performs  better  than 
the  Harvard  FFQ.  While  Harvard  achieved  higher  correlations  among  Hispanics  than  the 
Block  FFQ,  neither  instrument  can  be  considered  adequate  for  Hispanic  women. 

Analyses  by  WIC  Category 

Women.  When  just  African-American  and  White  study  subjects  are  included,  the 
results  by  WIC  category  are  more  encouraging  than  they  appear  in  Table  4-8.  Among  Block 
FFQs,  eight  of  the  18  correlations  exceed  0.40;  among  Harvard  FFQs,  5  of  18  exceed  0.40. 
Block  had  higher  correlations  than  Harvard  for  five  of  the  six  nutrients  among  pregnant 
women,  and  in  all  of  the  six  nutrients  among  non-breastfeeding  women,  while  Harvard  and 
Block  were  each  higher  on  three  of  the  nutrients  among  breastfeeding  women. 

Children.  Among  children,  the  conclusions  about  the  performance  of  the  FFQs  is  not 
altered  by  the  ethnic-specific  analyses  Hispanics  are  not  the  source  of  the  poor  correlations; 
indeed,  their  results  are  superior  to  the  AA-W  mothers  in  three  of  the  six  Block  nutrient 
comparisons  and  four  of  the  six  Harvard  comparisons.  The  Harvard  AA-W  results  are  higher 
than  those  of  Block  in  four  of  six  comparisons,  but  none  of  these  correlations  exceeds  a 
relatively  low  0.3 1 .  Harvard  Hispanic  children  have  higher  correlations  than  Block's  in  four  of 
sbc  nutrients,  and  two  of  these  exceed  0  .40. 
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Results  for  Second  FFQ  Administration 

All  Cases  Included 

For  the  second  administration,  results  shown  in  Table  4-9  are  similar  to  those  for  the 
first  administration.  Most  of  the  Block  correlations  for  Whites  and  Afiican  Americans  are 
reasonably  acceptable.  Correlations  among  Hispanic  women  are  poor  by  both  instruments. 
The  Harvard  correlations  for  Hispanics  tend  to  be  higher  than  the  ones  for  Block,  but  neither 
instrument  produced  any  correlations  of  0.40  or  greater  in  this  ethnic  group.  Four  of  the  six 
correlations  for  children  are  higher  by  Block,  but  performance  by  both  instruments  is  poor  for 
Hispanic  women. 

FFQ  Outliers  Dropped 

Exclusion  of  outliers  did  improve  correlations  in  FFQ-2  for  about  three-fourths  of  the 
Harvard  FFQ-2  correlations,  and  about  half  of  the  Block  correlations.  Interestingly,  the 
exception  to  this  was  among  Hispanics,  whose  results  did  not  improve  after  exclusions.  This 
suggests  the  possibility  that  among  Hispanics,  at  least,  an  important  source  of  the  poor 
correlations  was: 

•  errors  in  the  reference  data  (the  diet  recalls);  and/or 

•  FFQ  errors  that  occurred  throughout  the  FFQs  in  a  way  not  amenable  to 
exclusion  based  on  either  excessively  high  energy  or  unreasonably  high 
fi-equencies  of  individual  foods. 

After  exclusion  of  outliers,  the  two  instruments  had  an  approximately  equal  number  of 
'Superior"  correlations,  that  is,  higher  than  the  other  FFQ  type,  although  in  some  cases  by  only 
minor  amounts.  Of  these  correlations  25  were  higher  for  Harvard  while  22  were  higher  for 
Block.  Additionally,  9  Harvard  correlations  and  12  Block  correlations  were  greater  than 
r  =  0.40.  When  Block  All  Cases  Included  was  compared  with  Harvard  FFQ  Outliers 
Dropped,  11  of  18  ethnic  comparisons  and  11  of  18  WIC  category  comparisons  were  higher 
for  Block,  suggesting  again  that  the  Block  instrument,  without  any  exclusions,  performed 
approximately  as  well  as  or  slightly  better  than  the  Harvard  FFQ  with  fiilly  13%  of  the  Harvard 
cases  excluded  due  to  outlier  energy  values. 

WIC  Dietary  Assessment  Validation  Study 
Final  Report  -  September  22,  1994 
Page  4-21 


Use  of  Standard  Medium  Portion  Size  with  the  Block  FFQ 

Also  examined  was  the  correlation  between  diet  records  and  the  Block  FFQ-1  when 
calculated  using  a  Standard  Medium  portion  size,  rather  than  the  customary  '^mall-medium- 
large"  approach.  It  was  thought  possible  that  it  might  perform  nearly  as  well  as  the  '^mall- 
medium-large '  approach;  if  that  were  the  case,  it  would  be  the  preferable  choice  for  WIC,  in 
that  it  is  less  complicated  (less  to  process)  for  the  WIC  client.  With  few  exceptions,  (data  not 
shown)  however,  correlations  using  a  Standard  Medium  were  considerably  lower  than  those 
shown  in  Table  4-8  for  the  Block  FFQ.  An  exception  was  for  non-breastfeeding  women, 
where  the  Standard  Medium  correlations  were  slightly  but  consistently  higher.  Among 
Hispanics,  the  Harvard  questionnaire  continued  to  show  higher  correlations  for  five  of  the  six 
nutrients.  Thus,  using  the  simpler  format  for  the  Block  FFQ  did  not  correct  the  poorer 
correlations  in  Hispanics.  However,  for  the  other  42  correlations  in  Table  4-8,  30  continued  to 
be  higher  than  the  corresponding  Harvard  correlations  using  only  Block's  standard  medium. 

Average  of  Estimates  from  FFQ-1  and  FFQ-2 

Averaging  two  administrations  of  the  FFQs  reduces  some  of  the  intraindividual 
variability  associated  with  respondent  errors  or  changes  in  diet.  Consequently,  correlation  of 
this  estimate  with  the  diet  recalls  gives  a  better  picture  of  the  'true"  correlation  between  the 
instrument  and  the  reference  data.  The  results  of  this  averaging  analysis  are  shown  in 
Appendix  D,  Table  D-3.  For  both  instruments  the  correlations  were  higher  when  the  FFQs 
were  averaged,  and  a  number  of  correlations  were  moved  above  0.50.  This  in  turn  suggests 
that  flirther  consideration  of  and  work  on  these  instruments  is  warranted  for  use  in  WIC 
settings. 

Reasons  for  Some  of  the  Poor  Results 

Often,  very  poor  correlations,  such  as  those  seen  in  some  of  the  results  in  Table  4-8, 
result  fi'om  just  one  or  a  few  study  subjects.  For  example,  we  explored  the  poor  correlation 
{r  =  0.12)  for  vitamin  C  seen  among  pregnant  women  by  the  Harvard  FFQ.  Among  the  27 
Whites  this  correlation  was  r  =  0.18.  However,  that  low  correlation  was  caused  entirely  by  a 
single  respondent  who  had  a  very  low  vitamin  C  intake  by  diet  recalls  (24  mg/day),  but  an 
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anomalously  high  vitamin  C  intake  by  FFQ  (586  mg/day).  She  reported  on  the  Harvard  FFQ 
that  she  had  oranges  once  per  day,  4  to  5  glasses  of  orange  juice  per  day,  4  to  5  glasses  of  Hi- 
C/Kool  Aid  per  day,  and  several  other  fruits  frequently.  With  this  single  respondent  excluded, 
the  correlation  among  the  remaining  26  White  pregnant  women  was  0.43.  Similarly,  the  low 
correlation  for  vitamin  C  among  Block  White  women  was  found  to  be  due  to  six  study 
subjects.  Excluding  these  six  subjects,  the  correlation  for  the  rest  of  the  68  women  in  that 
group  was  0.42. 

This  example  highlights  some  of  the  shortcomings  of  the  edit  criteria  used  by  each  of 
the  FFQ  instruments.  Apart  from  visual  editing,  the  Harvard  FFQ  excludes  study  subjects  only 
if  their  energy  estimate  exceeds  4,500  kcal.  While  indeed  excluding  numerous  erroneous 
responses,  this  approach  does  not  exclude  persons  with  erroneously  high  estimates  of  nutrients 
not  strongly  associated  with  energy,  such  as  vitamin  C.  The  Block  edit  criteria  excluded  study 
subjects  for,  among  other  things,  having  more  than  one  food  with  unreasonably  high  reported 
frequencies.  This  leaves  in  study  subjects  who  do  not  fail  on  two,  but  who  might  have  said,  for 
example,  that  they  eat  sweet  potato  twice  a  day,  a  single  unreasonable  frequency  that  would 
put  them  far  in  the  extreme  on  vitamin  A  intake. 

The  correlations  for  vitamin  C  for  the  Block  FFQ  are  a  great  deal  lower  than  has 
been  seen  in  other  validations  of  this  instrument,  and  lower  than  the  correlations  obtained 
for  other  nutrients  in  this  study.  Thus,  an  explanation  was  sought  for  these  results.  It  was 
discovered  that  the  frequency  categories  used  for  important  vitamin  C  sources  were 
different  in  this  instrument  than  in  previous  versions  of  the  Block  FFQ. 

In  previous  versions  of  the  Block  FFQ,  the  two  important  beverage  sources  of 
vitamin  C,  orange  juice  and  beverages  high  in  vitamin  C,  such  as  Hi-C  or  Kool  Aid,  have 
frequency  categories  with  a  maximum  of  two  times  per  day.  In  the  version  used  in  this 
study,  however,  these  beverages  were  placed  with  a  'beverage  group"  of  items,  and 
consumption  as  often  as  five  to  six  times  per  day  was  permitted.  A  possible  result  may 
have  been  that  those  respondents  wanting  to  indicate  a  high  frequency  of  intake  used  the 
maximum  category  of  five  to  six  times  per  day  and  thus  exaggerated  their  real  intake  (as 
measured  by  the  reference  recalls).  Unfortunately,  assuming  the  previously  used 
frequency  categories  with  a  maximum  of  two  times  per  day  for  calculation  purposes  did 
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not  alleviate  this  problem,  presumably  because  some  respondents  had  correctly  estimated 
their  frequency.  Changing  the  meaning  of  the  frequency  categories  improved  the 
overestimates  for  some  respondents,  but  misestimated  the  frequencies  of  respondents  who 
had  reported  correctly.  Thus,  it  is  not  possible  to  demonstrate  notably  improved 
correlations.  However,  it  is  likely  that  the  vitamin  C  correlations  will  be  comparable  to 
other  nutrient  correlations  seen  in  this  study,  and  to  previous  resuhs  for  vitamin  C,  if  the 
current  Block  FFQ  used  for  this  study  is  modified  to  reflect  the  previously  used  frequency 
categories.  It  is  advisable  to  revise  the  frequency  categories  for  juices  as  well  as  other 
beverages,  to  improve  correlations  and  reduce  overestimates. 

Comparison  of  Harvard  Results  with  Previously  Published  Suitor  Data 

Suitor  et  al.  (1989)  published  a  validation  study  using  an  FFQ  similar  to  the  Harvard 
FFQ  used  in  this  study.  The  most  comparable  data  to  those  of  Suitor  et  al.  are  those  from  the 
first  administration  of  the  FFQs,  before  any  exclusions  of  outliers,  for  pregnant  women.  For 
the  six  nutrients  considered  in  this  study,  the  present  correlations  for  FFQ-1  All  Cases  Included 
are  higher  than  Suitor's  for  three  nutrients,  similar  in  one,  and  lower  in  two  nutrients.  This 
similarity  of  results  is  particularly  reassuring  when  one  considers  in  detail  the  nature  of  the  two 
samples.  Suitor's  initial  sample  was  59%  White,  21%  Afiican  American  and  20%  Hispanic;  of 
these,  6-9  persons  were  dropped  before  the  calculation  of  Suitor's  FFQ-1  correlations;  while 
their  ethnicity  is  not  stated,  our  data  would  suggest  that  they  are  more  likely  to  have  been 
Hispanic  or  Afiican  American,  leaving  a  still  more  Caucasian  study  group.  In  comparison,  the 
sample  in  the  present  study  was  much  more  heavily  weighted  with  Hispanics  and  Afiican 
Americans,  each  comprising  approximately  one-third  of  the  study  sample.  Further,  the  Suitor 
data  include  only  those  Hispanics  who  were  able  to  complete  the  English  version  of  the  FFQ, 
whereas  in  the  present  study  approximately  80%  of  the  Hispanic  study  subjects  used  the 
Spanish-language  FFQs,  and  most  would  have  been  unable  to  complete  an  FFQ  in  English 
When  this  study's  Afiican- AmericanAVhite  data  are  compared  with  the  correlations  seen  by 
Suitor,  they  exceed  those  obtained  by  Suitor  for  all  nutrients  except  vitamin  C. 

Comparisons  of  Suitor's  first  questionnaire  after  exclusion  of  outliers  with  the  present 
Harvard  results  after  exclusion  of  outliers  have  several  interesting  aspects.   When  all  three 
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ethnic  groups  are  included,  the  present  correlations  are  considerably  lower  than  Suitor's. 
However,  correlations  of  data  among  Whites  are  higher  for  all  nutrients,  and  for  protein  and 
vitamin  A  are  substantially  higher  than  Suitor's.  In  a  further  exploratory  step,  the  data  were  log 
transformed,  as  Suitor  had  done,  rather  than  using  the  most  normalizing  transformation 
decision  (which  may  be  log,  square-root  or  no  transformation  at  all  depending  on  the  specific 
distribution).  Interestingly,  log-transformed  correlations  for  Whites  were  substantially  higher 
than  the  original  transformation  for  four  of  the  six  nutrients.  Thus,  considering  a  similar  ethnic 
distribution  and  applying  the  same  transformations,  the  present  results  for  the  Harvard  FFQ-1 
after  dropping  FFQ  outliers  were  similar  to  Suitors:  lower  for  calcium  and  vitamin  C, 
considerably  higher  for  protein  and  vitamin  A,  and  similar  for  energy  and  iron. 

Comparisons  of  the  second  administration  of  the  FFQ  in  the  present  study  (FFQ-2) 
with  Suitor's  second  administration  (PFFQ-2)  are  not  appropriate,  because  those  who  remained 
in  the  Suitor  study  through  to  the  second  administration  were  a  select  group.  As  noted  by 
Suitor  et  al.  (Suitor  1989),  'those  returning  PFFQ-2  were  unrepresentative  of  the  original 
sample,  being  mainly  White  adults,  high  school  graduates,  and  above  the  federal  poverty  level." 

Possible  Explanations  for  the  Poor  Performance  Among  Hispanic  Women 

There  are  several  possible  explanations: 

•  The  FFQs  do  not  have  suflBcient  or  correct  ethnic  foods  on  the  food  list; 

•  A  lack  of  familiarity  with  'data  collection"  forms,  or  culturally  different 
conceptualizations  about  reporting  food  intake,  may  have  made  it  more  diflBcult  for 
the  Hispanic  women  in  this  study  to  use  the  FFQs  as  intended  by  the  researchers; 

•  The  same  above  problems  of  education  and  abstract  thinking  make  it  difficult  to 
report  food  intake  correctly  on  the  diet  recalls; 

•  The  diet  recalls  may  not  accurately  reflect  their  dietary  intake  because  of  lack  of  or 
inaccurate  nutrient  content  information;  and/or 

•  The  diet  recalls  may  not  accurately  reflect  their  dietary  intake  because  of  the  error- 
proneness  of  the  process  of  recording  nutrient  and  portion  size  information  fi-om 
mixed  dishes. 

Each  of  these  is  discussed  below. 
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Not  Enough  or  Not  Correct  Ethnic  Foods  on  the  Food  List.  Further  work  in  this  area 
is  warranted;  however,  it  may  not  be  the  major  source  of  error.  Extensive  preliminary 
examination  of  nutrient  sources  in  Hispanic-HANES  (Block  1994)  revealed  a  relatively  minor 
contribution  of  most  ethnic  foods,  and  the  few  important  ones  were  included  on  the  Block 
FFQ.  Furthermore,  several  focus  groups  conducted  among  Hispanic  women  did  not  suggest 
important  additional  foods.  In  addition,  Hispanic  nutritionists  in  each  of  the  geographic  sites 
examined  the  draft  FFQ  prior  to  the  beginning  of  the  study,  in  an  effort  to  improve  both  the 
food  list  and  the  translations  used.  However,  it  should  be  noted  that  mixed  dishes  comprise  an 
important  part  of  Hispanic  diets,  and  therefore  it  may  be  that  more  specifically  Hispanic  mixed 
dishes  should  be  included. 

Lack  of  Familiarity  with  Data  Collection  Forms.  This  could  be  an  important  factor 
although  there  are  no  supporting  data  from  this  study  for  this  specific  hypothesis.  It  was 
measured  that  Hispanic  study  subjects  took  the  longest  time  to  complete  the  FFQs,  committed 
the  most  errors  and  required  the  most  assistance  and  explanation  (see  Section  4.2).  Perhaps 
related,  it  was  observed  that  the  educational  level  among  Hispanic  study  subjects  was 
considerably  lower  than  among  Whites  or  Afincan  Americans.  For  example,  5%  of  Hispanic 
women  had  only  0,  1  or  2  years  of  education  Fully  29%  of  the  Hispanic  women  in  this  study 
had  six  years  of  education  or  less.  In  comparison,  only  two  Afiican-American  women  and  no 
White  women  had  as  little  as  eight  years  of  education.  In  this  study  population  the  non- 
Hispanic  women  were  mostly  high  school  educated  with  only  18%  of  White  and  19%  of 
Afiican-American  women  having  less  than  a  full  12  years  of  school.  However,  the  poorer 
results  for  Hispanic  women  cannot  be  attributed  to  education  alone.  When  correlations  were 
examined  separately  by  educational  level,  they  were  not  any  higher  among  Hispanic  women 
with  9-12  years  of  education  than  they  were  among  those  with  only  0-8  years  of  education. 
Cultural  differences  in  relating  to  data  collection  forms,  perhaps  associated  with  the  educational 
experience,  is  a  possible  hypothesis  to  be  explored. 

Difficulties  In  Providing  Accurate  Diet  Recall  Data.  Considerable  data  suggest  that 
the  information  provided  by  the  Hispanic  women  in  this  study  was  of  relatively  'jjoorer" 
quality,  making  lower  correlations  inevitable.  Sources  of  error  here  include  both  memory 
errors  in  reporting  foods  consumed,  and  probably  more  importantly,  the  quantification  of 
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portion  size  as  part  of  the  reporting.  As  described  in  Section  3,  the  quantification  of  portion 
size  using  the  abstract  two-dimensional  shapes  appeared  to  be  diflBcult,  generally,  and  a 
potentially  serious  source  of  error.  Cultural  differences  related  to  recalling  diet  and  reporting 
food  intake  may  be  contributing  factors. 

Possibly  Inaccurate  Nutrient  Content  Information  for  Hispanic  Foods.  Because  many 
foods  are  not  standard  parts  of  the  U.S.  diet,  their  nutrient  content  data  may  be  less  reliable 
than  that  of  more  mainstream  foods.  Perhaps  also  important  may  be  the  micronutrient  content 
assumptions  by  the  NDS  database  for  some  fiiiit  drinks.  Among  Hispanics,  ethnic  or 
homemade  fiiiit  drinks  or  punches  are  an  important  dietary  factor.  Incorrect  assumptions 
about  vitamin  C  content,  for  example,  could  lead  to  serious  errors  for  that  nutrient. 

Diet  Recall  Errors  Due  to  Difficulties  in  Recording  Mixed  Dishes.  To  a  greater  extent 
than  among  Whites  or  Afincan  Americans,  prepared  mixed  dishes  comprise  a  substantial  part  of 
the  diet  among  Hispanics.  In  a  diet  recall,  mixed  dishes  are  obtained  in  two  ways:  either  a 
single  NDS  recipe  for  a  ndxed  dish  is  assigned  to  all  preparers  and  ethnic  subgroups;  or,  the 
recipe  must  be  recorded,  with  each  food  recorded  separately  by  type  and  portion  size.  This 
process  contains  the  possibility  of  error  in  remembering  accurately  the  amounts  of  each  food 
that  went  into  the  recipe  cooked  for  the  family;  difficulties  in  estimating  the  amount  of  the  final 
recipe  consumed  by  the  respondent;  and  the  possibility  that  the  interviewer  recording  the 
information  may  incorrectly  assign  the  proportion  of  each  food  in  the  recipe  that  was  consumed 
by  the  respondent. 

Suggestions  for  fiirther  research  to  improve  dietary  assessment  among  Hispanics  are 
included  in  Section  5.0. 

Possible  Explanations  for  the  Poor  Performance  Among  Mothers  Responding  for  Their 
Children's  Diets 

Again,  there  are  several  possibilities: 

•  Food  lists  perhaps  did  not  include  enough  infant  or  young  child  foods;  or  assigned 
portion  sizes  which  were  not  appropriate; 

•  The  process  of  thinking  about  their  children's  diets  on  a  food  fi^equency 
questionnaire  is  too  diflBcult; 
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•  Very  small  children's  diets  have  so  little  variety  that  the  range  of  intake  is  too  small 
to  permit  good  correlations, 

•  The  diet  recalls  are  poor  reflections  of  the  children's  diets  because  the  mothers  may 
not  know  what  the  children  eat  in  day  care  or  fiiends/relatives'  care; 

•  The  quantification  of  portion  size  by  the  mothers  in  the  diet  recalls  is  diflBcult  and 
error-prone;  and/or 

•  The  diet  recalls  are  poor  reflections  of  the  children's  diets  because  nutrient  content 
information  is  not  appropriate  for  the  foods^uices  commonly  consumed  by  young 
children. 

Each  of  these  is  discussed  below. 

Food  Lists  or  Portion  Sizes  Not  Appropriate.  It  appears  unlikely  that  food  lists  or 
inappropriate  portion  sizes  are  a  major  source  of  the  errors.  The  Harvard  instrument  based  the 
food  list  on  an  extensive  examination  of  CSFII  data  for  children,  and  the  portion  sizes  on 
USDA  data  on  children's  portion  sizes.  Similarly,  the  Block  instrument  based  the  additions  to 
the  food  list  on  NHANES  n  and  Mspanic-HANES  data  on  nutrient  sources,  and  portion  sizes 
among  low-income  children  ages  1-4. 

Difficulties  of  Mothers  in  Reporting  About  Their  Child's  Diets.  In  pretesting  of  the 
Block  FFQ  among  WIC  mothers,  it  was  observed  that  sometimes  the  mothers  forgot  that  they 
were  supposed  to  be  reporting  on  their  child's  diet,  and  slipped  into  reporting  on  their  own  diet. 
(To  minimize  this  problem,  the  form  was  changed  to  request  that  the  mother  write  the  child's 
name  at  the  top  of  each  page.)  While  this  particular  problem  may  have  provided  some  source 
of  error,  it  is  unlikely  to  have  been  a  major  source.  Another  possibility  is  that  the  mothers 
optimized  the  reporting  of  their  children's  food  intake,  perhaps  out  of  embarrassment  or  guilt  at 
revealing  poor  dietary  practices.  However,  a  more  likely  explanation  is  simply  that  it  is  a 
difficult  and  abstract  task  to  report  on  how  fi-equently  someone  else  eats  a  food. 

Limited  Variety  in  Small  Children's  Diets.  Small  children's  diets  are  very  restricted. 
Often,  the  resulting  questionnaires  report  consumption  of  cooked  or  dry  cereal,  baby  food  fruit, 
milk,  and  a  few  snack  foods.  While  the  resulting  diet  may  actually  be  nutritionally  adequate, 
the  intake  of  protein  and  micronutrients  may  vary  over  a  very  small  range  in  the  sample  of  small 
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children.  Under  circumstances  of  a  very  narrow  range,  it  is  simply  mathematically  diflScult  to 
achieve  high  correlation  coeflScients,  in  part  because  it  requires  a  much  greater  degree  of 
precision  on  the  part  of  the  FFQ.  Additionally,  when  very  few  foods  are  reported,  the 
importance  of  accurately  reporting  portion  size  of  those  foods  in  the  diet  recalls  increases. 
However,  while  this  lack  of  variability  in  small  children's  diets  may  be  a  factor,  better 
correlations  among  the  older  children  could  not  be  demonstrated  in  these  analyses.  It  was 
found  that  the  correlations  among  3-4-year  olds  were  not  better  than  the  correlations  among  1- 
2-year  olds  (data  not  shown). 

Diet  Recalls  May  Be  Inaccurate  Because  Mothers  Don't  Know  the  Entire  Diet  of 
Child  By  study  design,  mothers  were  to  be  enrolled  only  if  they  in  fact  had  supervision  of  their 
children  during  the  day,  that  is,  the  children  were  not  to  be  in  day  care,  etc.  Some  mothers  may 
have  misunderstood  the  question,  and  thus  it  is  possible  that  some  children  were  included  in  the 
study  who  were  not  in  formal  day  care  facilities,  but  who  were  taken  care  of  by  relatives. 
Finally,  inevitably  all  mothers  have  occasion  to  leave  their  children  with  relatives  or  friends 
from  time  to  time  to  do  errands,  etc.,  and  thus  they  would  not  know  exactly  what  their  children 
had  eaten  during  those  periods.  While  this  is  an  important  element  of  study  design  for  fiiture 
studies,  it  is  unlikely  to  be  a  major  source  of  error  in  this  study,  in  part  because  it  was  largely 
avoided  by  design,  and  in  part  because  the  mother's  ignorance  of  the  child's  complete  diet 
would  have  been  true  for  both  the  diet  recalls  and  the  FFQs. 

Errors  in  Diet  Recalls  Due  to  Portion  Size  Quantification.  As  indicated,  the  visual 
two-dimensional  portion  size  models  were  found  to  be  diflBcult  to  relate  to  actual  utensils,  and 
a  probable  source  of  error.  Glass  sizes  were  diflBcult  to  visualize  and  translate  into  actual  three- 
dimensional  glasses.  Exaggeration  or  minimization  of  the  glass  sizes  of  milk  consumed  by  a 
child  could  introduce  major  errors  in  estimation  of  energy,  protein,  calcium  and  vitamin  A. 

Diet  Recall  Database  May  Not  Be  Appropriate  for  Foods  Consumed  by  Small 
Children.  The  nutrient  content  of  jars  of  baby  food  is  probably  accurately  contained  on  the 
database.  However,  young  children  drink  a  lot  of  juices,  and  it  may  be  possible  that  the 
'hippies,"  juice  boxes  and  similar  drinks  enjoyed  by  children,  do  not  have  accurate 
corresponding  codes  on  the  database.  The  nutrient  content  of  Kool  Aid  illustrates  the  type  of 
error  that  can  lead  to  misestimation  of  nutrient  intake  of  children.   According  to  the  Kraft 
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General  Foods  corporation,  there  is  no  calcium  in  Kool  Aid;  the  codes  used  for  Kool  Aid  in  the 
NDS  database,  however,  provide  a  considerable  amount  of  calcium. 

Companson  of  Diet  Recalls  vs.  Food  Frequency  Questionnaires 

The  correlations  shown  in  this  section  for  the  Block  FFQ  for  African  American  and 
White  (AA-W)  women.  Table  4-8,  are  within  the  range  of  0.4  to  0.6  for  most  nutrients.  After 
adjustment  for  measurement  error  in  the  diet  recalls,  correlations  for  those  two  groups  are  seen 
to  be  higher  (Appendix  D,  Table  D-1),  reaching  or  exceeding  0.5  for  7  of  the  12  comparisons. 
Values  such  as  these  indicate  an  ability  to  rank  individuals  along  the  distribution  of  intake  from 
low  to  high  that  is  quite  comparable  with  results  from  other  studies. 

It  was  of  interest  to  compare  these  correlations  with  those  that  might  be  seen  from  use 
of  a  single  research-quality  24-hour  diet  recall  as  the  assessment  instrument.  To  explore  this, 
the  sample  was  restricted  to  African-American  and  White  women,  the  subset  for  whom  the 
FFQ  seems  to  perform  adequately  and  who  had  all  completed  three  diet  recalls.  For  this 
comparison,  the  first  two  24-hour  diet  recalls  were  averaged,  and  the  performance  of  the  third 
diet  recall  was  assessed  by  correlating  it  with  the  average  of  the  other  two.  These  correlations 
were  compared  with  the  correlations  seen  for  the  Block  FFQ  against  the  two  averaged  diet 
recalls  (see  Table  4- 1 0). 

It  can  be  seen  that  the  correlations  achieved  by  the  FFQ  are  somewhat  lower  than  those 
achieved  by  a  single  24-hour  diet  recall  for  macronutrients,  but  are  similar  for  micronutrients. 
That  is,  for  macronutrients,  a  diet  recall  agrees  with  estimates  from  other  diet  recalls  better  than 
does  an  FFQ. 

Note  that  the  correlations  achieved  by  the  24-hour  diet  recall  are  probably 
overestimates,  because  of  the  problem  of  'torrelation  errors."   That  is,  a  person  may 
exaggerate  her  serving  size  of  cereal,  for  example,  on  all  three  diet  recalls.  This  will  produce 
good  apparent  agreement,  but  all  three  estimates  would  in  fact  be  incorrect.  It  is  because  of 
this  problem  of  correlated  errors  that  a  food  frequency  questionnaire  is  never  'Validated"  by 
comparing  it  against  another  FFQ.  The  'Validity"  estimate  would  be  incorrectly  high.  For  the 
same  reason,  it  is  likely  that  the  correlations  seen  for  one  24-hour  diet  recall  in  Table  4-10  are 
incorrectly  high.  Thus,  it  is  diflBcult  to  distinguish  the  agreement  due  to  corresponding  errors 
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from  the  agreement  due  to  accurate  nutrient  estimates,  in  the  first  column  of  Table  4-10.  This 
table  suggests,  however,  that  for  macronutrients,  a  research-quality  24-hour  diet  recall 
produces  better  agreement  with  other  diet  recalls  than  does  .¿..self-administered  FFQ  in  this 
low-income  population.  For  micronutrients,  an  FFQ  is  approximately  equal  to  a  research 
quality  24-hour  diet  recall. 


Table  4-10 

Spearman*  Correlations,  African-American  and  White  Women 

n  =  127 


Recall  3 

Block 

vs. 

FFQ-1  vs. 

Average 

Average 

of  Recalls 

of  Recalls 

Nutrient 

1  &  2 

1  &  2 

Energy 

0.57 

0.43 

Protein 

0.61 

0.45 

Vitamin  A 

0.33 

0.34 

Vitamin  C 

0  40 

0.40 

Iron 

0  44 

0.37 

Calcium 

0.61 

0.54 

*  Spearman  correlations  remove  the  requirement  for 
data  transformation. 


It  should  be  remembered  that  this  was  a  research-quality  24-hour  diet  recall,  taking 
approximately  20  minutes  to  complete  and  involving  probing  and  ascertaining  all  foods 
consumed  and  their  portion  sizes  and  preparation  methods.  Less  extensive  methods  of 
obtaining  diet  recall  data  would  result  in  lower  correlations  than  those  shown  here  for  Diet 
Recall  3.  For  situations  in  which  a  research-quality  24-hour  diet  recall  is  not  practical,  the 
analyses  in  Table  4-8  suggest  that  for  women  of  these  two  ethnic  groups  (AA-W),  a  food 
frequency  questionnaire  (here  the  Block  FFQ)  may  be  useful  for  assessing  nutrient  intake  and 
eligibility  in  the  WIC  clinic  situation. 
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Comparability  of  Nutrient  Databases 

The  nutrient  databases  used  in  each  FFQ's  computer  software  and  in  the  reference 
data  in  this  study  were  not  identical.  The  two  Block  and  Harvard  FFQs  used  databases 
developed  in  somewhat  different  ways.  The  Block  FFQ  database  was  initially  based  on 
the  NHANES  II  nutrient  database,  somewhat  updated  using  Revised  Handbook  No.  8. 
The  Harvard  WICENTER  database  was  developed  using  the  USDA  Nutrient  Data  Base 
for  Standard  Reference  (release  5,  Microcomputer  version)  also  updated  using  Revised 
Handbook  No.  8.  Each  of  these  FFQs  was  in  turn  compared  with  reference  data 
calculated  using  the  University  of  Minnesota  Nutrition  Data  System 's  (NDS)  unique 
nutrient  database. 

While  these  three  databases  may  seem  to  be  different,  it  should  be  remembered 
that  all  nutrient  databases  (including  NHANES  II;  USDA's  Standard  Reference;  and,  the 
University  of  Minnesota  database)  ultimately  obtain  their  nutrient  composition  data  from 
the  USDA.  NHANES  II  included  considerable  nutrient  data  from  food  manufacturers,  as 
does  the  Minnesota  database.  Use  of  the  Minnesota  nutrient  composition  database  to 
develop  an  FFQ  nutrient  database  might  have  increased  the  resulting  correlations 
somewhat.  However,  it  is  unlikely  that  it  would  have  made  a  substantial  improvement. 
Previous  validations  of  the  Block  FFQ  have  all  been  conducted  under  the  similar  situation 
where  the  FFQ  and  reference  databases  were  not  identical.  The  good  correlations 
obtained  in  those  validation  studies  suggested  that  the  FFQ  is  robust  to  such  database 
differences. 

In  an  attempt  to  determine  the  extent  to  which  database  differences  might  have 
influenced  the  results  of  this  study,  the  Block  FFQ  database  was  modified  to  make  it  more 
similar  to  the  Minnesota  nutrient  database,  and  the  correlations  with  the  NDS-based 
reference  data  recalculated.  Vitamin  C  was  selected,  because  the  correlations  for  that 
nutrient  were  uncharacteristically  low.  The  Minnesota  database  was  first  examined  for  the 
top  food  item  contributors  of  vitamin  C  in  the  Block  FFQ:  orange  juice,  oranges,  Kool 
Aid,  broccoli  and  dry  cereal.  The  values  for  dry  cereal  and  for  oranges  were  virtually 
identical  in  the  Block  and  NDS  databases.  Broccoli  values  differed  substantially 
depending  on  whether  the  broccoli  was  raw  or  cooked,  but  changing  the  FFQ  database 
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had  no  effect  on  the  correlations.  The  values  for  Kool  Aid  and  for  orange  juice  did  differ 
somewhat  in  the  Block  and  NDS  databases:  for  orange  juice,  48  mg.  vs  38  mg.  vitamin 
C/100  g;  and  for  Kool  Aid,  15  .6  mg.  vs.  2.4  mg.  vitamin  C/100  g  (for  at  least  one  of  the 
NDS  Kool  Aid  codes.) 

The  FFQ  database  was  changed  for  those  two  food  items  accordingly,  and  the 
nutrient  estimates  and  correlations  recalculated.  While  the  correlations  were  in  fact 
improved,  the  improvements  were  not  substantial.  Among  African-American  women,  the 
correlation  improved  from  r  =  0.35  to  r  =  0.37;  among  White  women,  the  correlation 
improved  from  r  0.19  to  r  =  0.24.  Thus,  it  appears  likely  that  differences  among  the 
databases  is  not  an  important  factor  in  the  results  observed  in  this  study. 

Conclusions  Based  on  FFQ  Validity  Correlations 

Improvements  are  needed,  and  are  possible,  for  both  FFQs.  Even  in  its  present  state, 
however,  the  Block  FFQ  produces  correlations  with  reference  data  for  Whites  and  African- 
American  WIC-eligible  women  which  are  not  substantially  poorer  than  correlations  obtained  by 
that  and  other  instruments  in  more  well-educated  populations.  (The  exception,  vitamin  C,  is 
poorer  in  this  study  than  in  other  validations  of  the  Block  FFQ  because  of  a  formatting  error.) 
Neither  FFQ  performs  adequately  for  Kspanic  women,  and  neither  FFQ  performs  adequately 
for  children.  Some  possible  reasons  for  that  are  discussed  above.  Some  of  the  reasons 
suggested  pertain  as  much  to  the  adequacy  of  the  reference  data  as  to  the  adequacy  of  the 
FFQs.  Thus,  the  potential  usability  of  FFQs  for  those  populations  should  not  be  discounted, 
but  further  investigation  is  clearly  needed. 
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4.4  CATEGORIZATION 


Analytic  Approach 

The  ability  of  FFQs  to  categorize  persons  as  either  low  or  high  on  the  distribution  of 
intake  is  a  useful  criterion  of  validity.  For  this  analysis,  the  distribution  of  diet  recall  data  for 
each  nutrient  was  divided  into  quartiles.  Likewise,  the  distribution  of  FFQ  nutrient  estimates 
was  also  divided  into  quartiles.  This  identifies  each  study  subject  in  a  specific  quartile  or 
category  for  each  estimating  method  (diet  recall  and  FFQ).  These  category  (quartile)  identities 
were  then  cross-tabulated  to  array  the  agreement  between  the  two  methods  of  categorization. 
A  chi-square  statistic  is  calculated  to  test  the  distribution  in  the  array  so  that  a  highly  significant 
chi-square  value  is  an  indication  of  a  significant  agreement.  The  largest  chi-square  value  would 
be  produced  when  all  cases  are  perfectly  distributed  along  the  diagonal  and  there  is  no 
misclassification. 

Because  the  correlation  analyses  presented  in  the  previous  section  suggested  that 
neither  FFQ  type  performed  adequately  for  Hispanics  and  for  all  children,  the  data  in  this 
categorization  analysis  have  been  restricted  to  Afiican-American  and  White  women  only. 

Results 

Tables  4-1 1  through  4-16  show  the  cross-tabulations  and  statistical  significance  of  the 
agreement  between  FFQ  and  diet  recall  categorization  within  quartiles  for  energy,  protein, 
vitamin  A,  vitamin  C,  iron  and  calcium  for  the  Harvard  and  Block  data.  The  Block  FFQ 
showed  statistically  significant  agreement  for  all  sbc  nutrients.  For  the  Harvard  FFQ, 
statistically  significant  agreement  was  seen  for  protein  and  calcium  but  not  for  energy,  vitamin 
A,  vitamin  C,  nor  iron. 
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Table  4-11 


Agreement  Between  FFQ-1  and  Average  Diet  Recall  for  Quartile 
Categories  of  ENERGY  Intake  Among  White  and  African-American  Women 


FFQ-1  Categories 


HARVARD 

Diet  Recall  Categories  (Quartiles) 


Pi  ret 

Thirri 

1  1  III  u 

Pm  ir^H 

~UUI  11 1 

Total 

First 

17 

11 

10 

3 

41 

Second 

9 

11 

11 

10 

41 

Third 

8 

10 

10 

14 

42 

Fourth 

7 

9 

11 

14 

41 

41 

41 

42 

41 

165 

FFQ-1  Categories 


Chi-Square  Significance:  p  =  0.11 

BLOCK 

Diet  Recall  Categories  (Quartiles) 


(Quartiles) 

First 

Second 

Third 

Fourth 

Total 

First 

14 

16 

7 

0 

37 

Second 

13 

8 

13 

4 

38 

Third 

8 

6 

11 

13 

38 

Fourth 

2 

8 

7 

20 

37 

37 

38 

38 

37 

150 

Chi-Square  Significance:  p<0.01 
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Table  4-12 

Agreement  Between  FFQ-1  and  Average  Diet  Recall  for  Quartile 
Categories  of  PROTECT  Intake  Amone  White  and  African-American  Women 

HARVARD 

FFQ-1  Categories 
(Quartiles) 

Diet  Recall  Categories  (Quartiles) 
First     Second     Third  Fourth 

Total 

First 

18 

9 

10 

4 

41 

Second 

10 

16 

7 

fi 
o 

41 

Third 

6 

7 

11 

18 

Fourth 

7 

9 

14 

11 

41 

41 

41 

42 

41 

165 

Chi-Square  Significance: 

p  <  0.01 

BLOCK 

FFQ-1  Categories 
(Quartiles) 

Diet  Recall  Categories  (Quartiles) 
First     Second     Third  Fourth 

Total 

First 

16 

13 

5 

3 

37 

Second 

9 

13 

13 

3 

38 

Third 

7 

10 

8 

13 

38 

Fourth 

5 

2 

12 

18 

37 

37 

38 

38 

37 

150 

Chi-Square  Significance: 

p  <  0.01 
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Table  4-13 


Agreement  Between  FFQ-1  and  Average  Diet  Recall  for  Quartile 
Categories  of  VITAMIN  A  Intake  Among  White  and  African-American  Women 


FFQ-1  Categories 


HARVARD 

Diet  Recall  Categories  (Quartiles) 


(Quartiles) 

First 

Second 

Third 

Fourth 

Total 

First 

14 

13 

7 

7 

41 

Second 

6 

9 

12 

14 

41 

Third 

10 

9 

13 

10 

42 

Fourth 

11 

10 

10 

10 

41 

41 

41 

42 

41 

165 

FFQ-1  Categories 


Chi-Square  Significance:  p  =  0.47 

BLOCK 

Diet  Recall  Categories  (Quartiles) 


(Quartiles)       First     Second     Third      Fourth  Total 


First 

20 

8 

7 

2 

Second 

10 

9 

10 

9 

Third 

4 

11 

13 

10 

Fourth 

3 

10 

8 

16 

37 


38 


38 


37 


37  38  38  37  150 
Chi-Square  Significance:  p  <0.01 
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Table  4-14 

Agreement  Between  FFQ-1  and  Average  Diet  Recall  for  Quartile 
Catesories  of  VITAMIN  C  Intake  Amone  White  and  African-American  Women 

HARVARD 

rrU-1  Categories 
(Quartiles) 

Diet  Recall  Categories  (Quartiles) 
First     Second     Third  Fourth 

Total 

First 

18 

5 

8 

9 

40 

Second 

9 

11 

10 

12 

42 

Third 

7 

10 

14 

11 

42 

Fourth 

7 

15 

10 

9 

41 

41 

41 

42 

41 

165 

Chi-Square  Significance: 

p  =  0.07 

BLOCK 

rrU-1  Categories 
(Quartiles) 

Diet  Recall  Categories  (Quartiles) 
First     Second     Third  Fourth 

Total 

First 

16 

11 

5 

5 

37 

Second 

8 

13 

12 

5 

38 

Third 

6 

6 

10 

16 

38 

Fourth 

7 

8 

11 

11 

37 

37 

38 

38 

37 

150 

Chi-Square  Significance: 

p  <  0.01 
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Table  4-15 

Agreement  Between  FFQ-1  and  Average  Diet  Recall  for  Quartile 
Categories  of  IRON  Intake  Among  White  and  African- American  Women 

HARVARD 

FFQ-1  Categories 
(Quartiles) 

Diet  Recall  Categories  (Quartiles) 
First     Second     Third  Fourth 

Total 

First 

17 

11 

6 

7 

41 

8 

9 

14 

10 

41 

Third 

6 

9 

12 

15 

42 

Fourth 

10 

12 

10 

9 

41 

41 

41 

42 

41 

165 

Chi-Square  Significance: 

p  =  0.12 

BLOCK 

FFQ-1  Categories 
(Quartiles) 

Diet  Recall  Categories  (Quartiles) 
First     Second     Third  Fourth 

Total 

First 

15 

11 

7 

4 

37 

Second 

12 

11 

10 

5 

38 

Third 

3 

13 

14 

8 

38 

Fourth 

7 

3 

7 

20 

37 

37 

38 

38 

37 

150 

Chi-Square  Significance: 

p  <  0.01 
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Table  4-16 

Agreement  Between  FFQ-1  and  Average  Diet  Recall  for  Quartile 
Categories  of  CALCIUM  Intake  Amone  White  and  African-American  Women 

HARVARD 

FFQ-1  Categories 
(Quartiles) 

Diet  Recall  Categories  (Quartiles) 
First     Second     Third  Fourth 

Total 

First 

18 

14 

5 

4 

41 

Second 

11 

10 

14 

6 

41 

Third 

7 

7 

13 

15 

42 

Fourth 

5 

10 

10 

16 

41 

41 

41 

42 

41 

165 

Chi-Square  Significance: 

p  <  0.01 

BLOCK 

FFQ-1  Categories 
(Quartiles) 

Diet  Recall  Categories  (Quartiles) 
First     Second     Third  Fourth 

Total 

First 

20 

10 

7 

0 

37 

Second 

6 

17 

9 

6 

38 

Third 

7 

7 

7 

17 

38 

Fourth 

4 

4 

15 

14 

37 

37 

38 

38 

37 

150 

Chi-Square  Significance: 

p  <  0.01 
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4.5  FFQ  NUTRIENT  ESTIMATES 


Analytic  Approaches 

For  the  analysis  of  nutrient  estimates,  emphasis  has  been  placed  on  the  first 
administration  of  the  FFQs,  with  all  study  subjects  included.  The  first  administration  is 
most  relevant  to  the  real  WIC  situation,  and  the  inclusion  of  all  study  subjects  mimics  the 
data  as  they  would  be  presented  to  a  WIC  nutritionist  in  the  absence  of  computerized 
analyses  and  edits.  Each  questionnaire's  group  mean  was  compared  with  the  group  mean 
fi-om  the  24-hour  diet  recalls,  and  a  t-test  performed.  Results  are  shown  in  Appendix  D 
Tables  D-4  through  D-9  are  calculated  with  no  FFQs  dropped  due  to  FFQ  outlier  values, 
while  Tables  D-10  through  D-15  represent  the  same  set  of  analyses  with  FFQs  dropped 
due  to  outlier  values.  Also  shown  separately  in  Appendix  D  are  the  results  of  nutrient 
estimates  for  FFQ-2  (the  second  FFQ  administration)  both  including  and  excluding  FFQ-2 
outlier  cases  (Tables  D-16  through  D-27). 

Nutrient  Estimate  Results 

Note:  All  tables  referred  to  in  this  section  are  located  in  Appendix  D.  The  tables  in 
Appendix  D  compare  the  diet  recall  average  estimates  to  the  computer  calculated  FFQ 
estimates  for  the  Harvard  and  the  Block  FFQs.  Energy  plus  the  estimates  for  the  five 
nutrients  of  interest  are  presented.  Medians,  less  influenced  by  extremely  high  values, 
are  also  presented.  Statistical  significance  in  comparing  these  estimated  mean  values  is 
defined  as  a  p-value  of  less  than  0. 05.  All  p-values  presented  in  these  tables  have  been 
rounded  to  two  decimal  places. 


No  FFQ  Outliers  Dropped 

Energy  (Table  D-4).  FFQ  estimates  for  energy  intake  are  consistently  lower  for 
the  Block  FFQ  than  the  Harvard  FFQ.  Except  for  White  women,  the  Harvard  FFQ 
significantly  overestimates  mean  energy  intake.  The  Harvard  mean  FFQ  energy  intake  of 
2,685  kcal  for  All  Women  is  significantly  higher  than  the  diet  recall  estimate  of  1,994  kcal 
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while  there  is  no  difference  in  the  Block  mean  estimate.  For  Children,  energy  was 
significantly  overestimated  by  Harvard  (2,043  FFQ  kcal  vs.  1,259  diet  recall  kcal),  but  was 
not  overestimated  by  Block. 

Protein  {Table  D-5).  For  protein,  both  FFQ  median  estimates  for  All  Women  are 
similar  to  the  diet  recall  medians;  the  mean  intake  of  protein,  however,  is  overestimated  by 
both  types  of  FFQs,  indicating  the  presence  of  outliers  elevating  the  mean  values.  Protein 
was  significantly  overestimated  for  Children  by  both  Harvard  and  Block. 

Vitamin  A  (Table  D-6).  Both  FFQs  significantly  overestimated  vitamin  A  in  all 
categories,  ethnic  groups.  The  overestimate  was  generally  greater  for  the  Harvard  FFQ. 
Vitamin  A  was  significantly  overestimated  for  Children  by  both  Harvard  and  Block  with 
the  Harvard  overestimates  being  greater. 

Vitamin  C  (Table  D-7).  Both  instruments  overestimated  mean  vitamin  C  intake  in 
all  categories,  however  only  the  Harvard  FFQ  overestimates  were  statistically  significant. 
For  Children,  vitamin  C  was  significantly  overestimated  by  Harvard  but  not  by  Block. 

Iron  (Table  D-8).  For  All  Women,  both  FFQs  produced  identical  median 
estimates  of  iron  (10.8  mg)  which,  in  both  cases,  were  lower  than  the  diet  recall  medians. 
The  observed  presence  of  some  very  high  iron  estimates  among  All  Women  in  the  Harvard 
data  elevated  the  mean  considerably  higher  than  the  median,  producing  a  mean  iron  intake 
estimate  not  significantly  different  from  the  diet  recall  mean.  The  estimate  of  the  Block 
FFQ  mean  iron  intake  of  11.6  mg  for  All  Women  is  significantly  below  the  diet  recall 
estimate  of  14.3  mg.  For  Children,  iron  was  significantly  underestimated  by  Block  but 
was  accurate  for  Harvard. 

Calcium  (Table  D-9).  Both  FFQs  significantly  overestimated  calcium  in  all  ethnic 
groups  and  all  categories.  Calcium  was  significantly  overestimated  for  Children  by  both 
Harvard  and  Block. 
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Summary  of  Women  by  WIC  Category.  Energy  was  significantly  overestimated  in 
the  women  in  all  three  WIC  categories  by  Harvard  but  not  by  Block.  Both  FFQ  types 
overestimated  vitamin  A  and  calcium  in  all  categories.  Vitamin  C  was  accurately 
estimated  by  Block  and  significantly  overestimated  by  Harvard  in  all  categories.  Results 
for  protein  and  iron  varied  in  different  categories,  but  not  consistently  for  either  Harvard 
or  Block  FFQs.  Data  for  these  pregnant,  breastfeeding  and  non-breastfeeding  categories, 
as  well  as  the  results  for  each  of  the  ethnic  groups,  can  be  found  in  Tables  D-4  through  D- 
9  in  Appendix  D. 

FFQ  Outliers  Dropped 

The  analyses  described  above  were  repeated  for  both  FFQ  types  excluding  those 
FFQs  which  were  identified  as  unreHable  based  on  each  FFQ's  respective  editing  criteria. 
The  resuhs  of  these  analyses  are  shown  in  Tables  D-10  through  D-15  in  Appendix  D. 

The  exclusion  of  outlier  FFQs,  substantial  for  some  groups,  reduced  Harvard's 
macronutrient  overestimations  and  introduced  a  significant  underestimate  for  the  protein 
intake  of  Harvard  White  women.  Dropping  outlier  FFQs  did  not  relieve  the  overestimates 
of  calcium  and  vitamin  A  for  either  instrument  with  the  one  exception  of  calcium  intake 
among  Harvard  White  women  becoming  an  accurate  estimate.  The  dropping  of  outliers 
made  the  Harvard  instrument  underestimate  iron  intake  (where  it  did  not  before)  while  the 
Block  instrument  continued  to  underestimate  iron  intake. 

Comparison  of  Harvard  ""Outlier  FFQs  Dropped"  with  Block  "'No  FFQs  Dropped" 
(Data  not  shown) 

This  is  an  attempt  to  compare  the  two  instruments  using  identical  exclusion 
criteria,  namely  kcal  >  4,500,  since  only  eight  Block  FFQs  exceeded  that  energy  level. 
Examining  the  number  of  t-tests  that  produced  a  significant  difference  (p  <  0.05)  between 
the  FFQ  estimate  and  the  diet  recall  estimate.  Harvard  and  Block  have  an  equal  number  of 
such  significant  misestimates  for  All  Women,  Afiican-American  women  and  breastfeeding 
women.  Harvard  has  one  more  significant  misestimate  than  Block  for  White  women  and 
pregnant  women,  and  Harvard  has  two  more  significant  misestimates  than  Block  for 
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Hispanic  women,  non-breastfeeding  women,  and  children.  On  this  basis,  the  Block  FFQ 
with  no  study  subjects  excluded  produced  better  point  estimates  of  group  mean  intake 
than  the  Harvard  FFQ,  even  after  the  exclusion  of  Harvard  outliers. 

Second  Questionnaire.  FFO-2  (Tables  D-16  to  D-27  in  Appendix  D) 

The  FFQ-2  results  benefit  fi'om  the  participant's  learning  experience  involving  both 
the  prior  administration  of  the  same  FFQ,  and  the  three  intervening  telephone  interviews 
about  dietary  intake.  The  FFQ-2  data  show,  as  many  other  researchers  have  seen,  that  a 
second  administration  produces  lower  estimates  of  mean  nutrient  intake,  and  this  was  true 
both  for  Harvard  and  for  Block.  For  All  Women,  the  Harvard  mean  energy  dropped  fi"om 
2,685  kcal  in  FFQ-1  to  2,255  in  FFQ-2,  while  the  Block  mean  energy  dropped  fi'om  2,034 
in  FFQ-1  to  1,730  kcal  in  FFQ-2.  This  created  some  new  significant  underestimates 
(Examples:  Block  energy  intake  among  All  Women,  Table  D-16;  Harvard  iron  intake 
among  All  Women,  Table  D-20).  It  also  reduced  some  previously  significant 
overestimates  to  non-significance  (for  example:  Harvard  and  Block  protein  intake  among 
All  Women,  Table  D-17).  Given  the  FFQ-2  estimates,  general  conclusions  about  the 
instruments  examined  in  this  study  are  unaltered. 

Block  Questionnaire  Using  Standard  Medium 

Block  questionnaires  ask  the  respondent  to  report  whether  her  usual  portion  size 
was  '^mall,  medium  or  large"  (S-M-L),  and  in  the  WIC  version  this  was  phrased  as 
'tompared  to  other  women  your  age."  Use  of  such  a  portion  size  question  has  been 
shown  to  result  in  superior  correlations  with  reference  data  than  use  of  a  standard  medium 
portion  size  assumption.  However,  since  the  omission  of  the  portion  size  section  would 
simplify  fijture  questionnaires  for  this  population,  this  approach  was  also  investigated. 

Because  poorer  correlations  were  noted  for  'hiedium  only"  in  Section  4.3,  detailed 
tables  of  means  are  not  shown  here  but  were  examined.  In  All  Women,  children  and  each 
ethnic  group,   use  of  'hiedium  only"  produced  overestimates,   or  more  severe 
overestimates,  of  energy,  protein,  vitamin  A,  vitamin  C  and  calcium.  This  approach  often 
resulted  in  statistically  significant  differences  from  the  reference  data  in  cases  where  the  S- 
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M-L  approach  had  not.  Only  for  iron,  which  had  been  consistently  underestimated  with 
the  S-M-L  approach,  did  the  higher  estimates  from  'hiedium  only"  produce  estimates 
closer  to  the  reference  data,  although  still  statistically  significantly  lower  than  the  reference 
data. 

This  observation  of  overestimates  produced  by  'hiedium  only"  is  consistent  with 
earlier  data  indicating  that  standard  medium  portion  sizes  fail  to  capture  gender  and  age 
differences.  For  example,  standard  medium  portion  sizes  dramatically  underestimate  the 
nutrient  intake  of  young  and  middle-aged  men,  and  substantially  overestimate  the  nutrient 
intake  of  older  women.  Previous  data  had  suggested  that  they  might  be  reasonably 
appropriate  for  young  to  middle-aged  women,  but  the  present  data  indicate  that  this  is 
apparently  not  the  case  for  WIC-eligible  women.  These  results  indicate  that  use  of  a 
'hiedium  only"  approach  produces  worse  estimates  than  '^mall-medium-large,"  and  is  not 
to  be  recommended. 

Vitamin  Supplements  (Block  FFQ  only).  Vitamin  supplement  use  was  also  obtained  in 
both  the  diet  recall  data  and  the  Block  FFQ  (but  not  the  Harvard  FFQ).  Due  to  FNS'  interest 
in  nutrients  from  foods  only,  the  values  are  not  presented  here.  The  results  provide  insight, 
however,  into  the  use  of  vitamin/mineral  supplements.  On  the  FFQ,  only  about  one-third  of 
women  reported  consuming  no  vitamin  supplements.  (Note  that  two-thirds  of  the  women 
were  either  pregnant  or  breastfeeding.)  Supplements  were  primarily  consumed  in  the  form  of 
multiple  vitamins  or  prenatal  vitamins,  principally  in  the  amounts  found  in  the  range  of  the 
Recommended  Dietary  Allowances  (RDA).  In  the  case  of  iron,  the  amounts  consumed  in  a 
few  cases  appeared  to  warrant  some  concern.  About  half  of  the  women  reported  consuming  a 
total  of  60  mg  of  iron  per  day,  apparently  the  amount  in  a  commonly  consumed  prenatal 
vitamin.  However,  approximately  5%  of  the  women  reported  consuming  120  mg  of  iron  per 
day,  an  amount  much  higher  than  the  RDA  for  pregnant  women.  Occasional  large  amounts 
were  also  seen  in  the  diet  recalls. 

Nutrient  Estimation  Conclusion 

Both  instruments  consistently  and  significantly  overestimated  vitamin  A  and 
calcium.  While  the  diet  recall  mean  vitamin  A  intake  is  approximately  900  RE  for  All 
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Women,  Block  estimates  about  1,500  RE  and  Harvard  estimates  about  2,500  RE.  These 
overestimates  are  amenable  to  improvement.  The  Block  calcium  overestimate  might  be 
improved  for  the  WIC  population  by  handling  the  low-fat  milk  issue  differently  and  not 
having  two  separate  milk  lines;  Harvard  might  be  improved  by  dropping  some  of  the  less 
important  dairy  items.  The  Harvard  overestimate  of  vitamin  A  could  be  reduced  by 
dropping  some  of  the  vegetable  and  fruit  items,  while  the  Block  instrument  might  consider 
dropping  liver.  With  the  existing  data,  it  is  possible  to  explore,  in  the  Block  data  set,  the 
importance  of  specific  foods  to  the  group's  nutrient  intake,  and  whether  dropping  certain 
foods  would  improve  point  estimates  without  weakening  the  correlations.  Such 
explorations  could  also  be  done  in  the  Harvard  data,  using  the  Block  software. 

Overall,  it  would  appear  that  the  Block  estimates  tend  to  be  closer  to  the  diet  recall 
group  means  and  medians  than  are  the  Harvard  estimates.  It  should  be  noted  that 
production  of  accurate  point  estimates  of  group  means  was  probably  not  a  primary 
consideration  in  the  development  of  either  instrument.  This  has  not  been  stated  clearly  for 
the  Harvard  instrument,  but  it  has  for  the  Block  instrument.  Previous  work  by  Block  with 
earlier  instruments  suggested  that  an  instrument  of  only  60  items  will  tend  to 
underestimate  macronutrients  (Block  1990b).  That  did  not  prove  to  be  the  case  for  the 
Block  instrument  in  this  WIC  population,  at  least  in  FFQ-1,  possibly  because  the  diet  in 
this  population  is  less  varied  and  therefore  a  shorter  list,  properly  chosen,  captures  their 
total  diet  adequately.  That  the  instruments  consistently  overestimate  vitamin  A  and 
calcium  is  largely  a  function  of  the  number  of  appropriate  foods  on  the  list,  and  is 
amenable  to  improvement.  But  a  questionnaire  can,  in  principle,  still  rank  people  correctly 
despite  serious  misestimates.  Thus,  conclusions  about  the  value  of  one  questionnaire  over 
another  should  not  rest  on  their  relative  accuracy  in  estimating  group  mean  nutrient 
intakes. 

National  Nutrient  Estimates  for  WIC  Participants 

In  response  to  a  requested  analysis  by  the  Office  of  Management  and  Budget 
(OMB)  related  to  this  study,  national  estimates  of  nutrient  intake  were  calculated.  That  is, 
using  the  recall  data  provided  by  the  African- American,  Hispanic  and  White  participants  in 
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this  study,  separately  for  women  and  children,  the  nutrient  estimates  were  weighted  to 
USDA's  1992  WIC  participant  data  for  the  nation.  The  methodology  used  and  the 
resulting  estimates  for  women  and  children  are  shown  in  Appendix  E-6. 

4.6      MANUAL  SCORING 
Analytic  Approach 

The  performance  of  a  manual  scoring  system  is  of  great  importance  in  judging  the 
appropriateness  of  food  frequency  questionnaires  for  the  WIC  system.  Because  of 
financial  and  logistic  constraints,  it  is  likely  that  few  WIC  agencies  would  be  able  to 
computer-score  these  instruments  in  order  to  use  them  for  eligibility  decisions.  Although 
this  could  change  in  the  future  if  validity  and  usability  were  demonstrated  and  resources 
were  made  available,  at  the  present  time  diet-related  eligibility  decisions  will  have  to  be 
made  on  the  basis  of  the  manual  scores. 

The  Harvard  and  Block  scores  differ  considerably  in  their  methods  and  criteria  for 
their  development.  Harvard  scores  were  developed  by  Gardner/Suitor  during  the  course 
of  an  earlier  cooperative  agreement  with  FNS,  and  are  based  on  numbers  of  servings  from 
five  food  groups;  they  produce  a  '^ass/fail"  result  for  each  food  group.  Block  scores 
were  developed  by  selecting  a  subset  of  foods  on  the  questionnaire,  'indicator  foods'  that 
represented  the  top  contributors  of  the  nutrients  in  question;  they  produce  scores  that  are 
continuous  variables  for  each  nutrient 

In  the  Harvard  manual  score,  laminated  templates  overlay  each  page,  and  reported 
servings  of  each  food  in  a  group  are  counted  based  on  the  column  headings  (1/day,  5- 
6/day,  6+/day,  etc.).  In  the  Block  manual  score,  each  of  the  'indicator'  foods  is  scored 
with  a  numeric  value  0-4,  and  the  foods  then  summed  for  each  nutrient.  Both  methods  are 
rapid,  requiring  only  a  median  of  three  minutes  to  score. 

In  the  analyses  below,  several  different  possible  eligibility  criteria  are  considered, 
and  the  performance  of  each  scoring  system  evaluated  in  relation  to  these  different  criteria. 
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Results 

Criterion  I  -  "Below  100%  of  the  RDA  on  any  one  of  the  five  nutrients" 

One  possible  eligibility  criterion  might  be  to  certify  as  eligible  if  any  one  of  the  five 
nutrients  was  below  the  RDA.  If  that  were  the  criterion,  however,  95%  of  All  Women  are 
'feligible"by  the  diet  recall  data.  In  this  situation,  a  rational  WIC  decision  would  simply  be 
to  declare  all  100%  to  be  eligible.  Given  the  imperfect  nature  of  dietary  data,  including 
recall  data,  use  of  any  instrument  to  attempt  to  discriminate  between  the  5%  and  the  95% 
is  inappropriate  and  perhaps  even  litigable.  Furthermore,  while  certifying  all  applicants  as 
eligible  may  be  ethically  defensible,  it  does  not  satisfy  the  fiscal  need  of  WIC  agencies  for 
flexibility. 

With  95%  of  women  'eligible'  by  the  recall  data,  statistically  valid  comparison  of 
the  two  FFQs  becomes  impossible.  When  there  are  only  5%  who  don't  fail  on  this 
criterion,  the  numbers  and  the  cell  sizes  become  too  small  to  evaluate  appropriately.  For 
example,  in  each  FFQ  type  only  11  or  12  women  were  'not  eligible'  by  this  criterion,  0 
pregnant  women,  5  breastfeeding,  6-7  non-breastfeeding. 

As  would  be  expected,  an  FFQ  that  'certifies'  approximately  95%  of  all  study 
subjects  will,  by  chance  alone,  'correctly'  certify  95%  of  those  truly  eligible.  This  was  the 
case  with  the  Harvard  score.  None  of  the  chi-square  or  Fisher's  Exact  Tests  were 
statistically  significant,  meaning  that  if  one  wanted  to  certify  only  95%  of  the  population, 
one  would  do  as  well  by  randomly  picking  a  number  from  I  to  20  as  one  would  by  using 
an  FFQ.  Neither  questionnaire  proved  statistically  able  to  classify  correctly  the  remaining 
5%.  In  only  two  cases  was  there  a  Fisher's  Exact  Test  that  approached  significance, 
namely  the  Block  FFQ  for  All  Women  and  for  breastfeeding  women.  But  Table  4-17 
illustrates  the  essential  meaninglessness  of  such  a  result. 

Table  4-18  summarizes  the  results  of  the  analyses  for  this  potential  criterion.  The 
p-values  indicate  the  statistical  significance  of  classification  tables  like  that  shown  in  Table 
4-17  (i.e.,  above  and  below  100%  of  the  RDA  by  FFQ  score  results)  for  each  sample 
subgroup.  A  p-value  <  0.05  would  indicate  an  ability  of  the  FFQ  to  discriminate  between 
those  who  failed  one  or  more  nutrient  RDAs  on  their  diet  recalls  and  those  for  whom  all 
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five  nutrients  were  adequate.  Note  that  about  95%  of  All  Women  and  about  85%  of  all 
children  failed  at  least  one  diet  recall  RDA. 

Conclusion.   This  criterion  is  not  appropriate  as  an  eligibility  screener  for  WIC, 
nor  is  it  helpful  in  identifying  which  FFQ  may  be  useful  for  WIC  eligibility  decisions. 

Criterion  II  -  "A  specific  nutrient  or  nutrients  below  1 00%  of  the  RD A" 

A  second  possible  eligibility  criterion  might  be  to  certify  those  who  are  below  the 
RDA  on  particular  nutrients.  While  providing  some  flexibility  for  WIC,  the  analysis  is 
complicated  by  the  differing  nature  of  the  two  manual  scoring  systems.  Harvard  scores 
are  based  on  numbers  of  servings  from  food  groups.  They  produce  a  dichotomous 
'^ass/fail"  result  for  each  of  five  food  groups.  Block  scores,  in  contrast,  produce  a 
continuous  variable  for  each  of  five  nutrients  (ranging,  for  example,  from  0  to  75).  Thus, 
several  complications  arise.  First,  one  scoring  system  is  keyed  to  food  groups  while  the 
other  is  keyed  to  nutrients.  The  accuracy  of  the  food-group-based  eligibility  decisions 
cannot  be  directly  tested  because  food  groups  are  not  accessible  from  the  diet  recall  data. 
(Some  judgments  can  be  made  based  on  comparability  with  national  data;  see  Food 
Groups  later  in  this  Section.)  Thus,  comparisons  of  the  food-group-based  Harvard  scores 
with  diet  recall  nutrients  is  not  completely  appropriate  and  does  not  directly  reflect  the 
intentions  of  the  Harvard  developers.  Second,  the  Block  score  produces  a  continuous 
variable  rather  than  a  single  dichotomous  decision;  the  cutpoint  to  be  used  for  a 
dichotomous  decision  (pass/fail)  is  variable  and  arbitrary.  The  cutpoint  used  here,  in  order 
to  be  able  to  compare  the  two  methods  with  respect  to  dichotomous  decision  rules 
(above/below  the  RDA)  was  not  based  on  knowledge  of  nutrient  distributions  among  WIC 
women  and  children.  Thus,  for  both  manual  scoring  systems  the  methods  used  to  test  and 
compare  them  are  only  imperfectly  appropriate  or  comparable. 
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Table  4-17 

Classification  of  Recalls  and  FFQs  Relevant  to  100%  of  the  RDA 

Block  FFQ,  Breast-feeding  Women 

Diet  Recall  Results 

FFQ  Scores 

All  nutrients 

One  or  more  nutrients 

>  100%  RDA 

<  100%  of  RDA 

All  manual  scores 

indicate  diet  OK 

3 

13 

1  or  more  scores 

indicate  not  OK 

2 

55 

Table  4-18 

Statistical  Significance  of  Classification  of  Recalls  and  FFQ 

Manual  Scores  Relevant  to  >  100%  of  the  RDA* 

Category 

Harvard  p-values 

Block  p-values 

All  Women 

0.41 

0.07 

All  Children 

0.56 

0.59 

Pregnant 

na  (all  <  RDA) 

na  (all  <RDA) 

Breast-feeding 

0.82 

0.07 

Not  Breast-feeding 

0.25 

0.29 

African-Annerican 

0.90 

0.11 

Hispanic 

0.27 

0.28 

White 

0.94 

0.77 

*  A  p-value  <0.05  would  indicate  a  manual  score's  ability  to  correctly 

distinguish  between  those  with  all  recall  nutrients  above  the  RDA  and 

those  with  one  or  more  low  nutrient  levels. 
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The  results  shown  in  Table  4-19  assess  the  extent  to  which  the  manual  scores  can 
correctly  categorize  study  subjects  as  above  or  below  the  RDA.  Block  scores  were 
compared  with  their  relevant  nutrients.  Harvard  scores  were  compared  with  the  nutrients 
most  directly  relevant:  Dairy  with  calcium.  Fruits  with  vitamin  C,  Vegetables  with  vitamin 
A,  Meats  with  protein.  Grains  with  iron.  (Note  that  for  vitamin  C,  Vegetables  was  also 
compared,  as  was  the  combination  of  Vegetables  and  Fruits;  neither  of  these  were  as  good 
as  Fruits  alone.  For  iron,  Meats  were  also  compared,  as  was  the  combination  of  Meats  and 
Grains;  neither  of  these  was  as  good  as  Grains,  except  in  occasional  race/category 
groups). 

Results  for  All  Women  and  Children  are  shown  below,  for  the  Harvard  ')Dass\fail" 
scores  and  the  initially-proposed  cutpoints  for  the  Block  scores.  One  possible  evaluation 
of  manual  scoring  methods  concerns  the  proportion  of  the  population  falling  below  the 
RDA.  Table  4-19  shows  these  proportions  (as  a  percent)  for  manual  scores  and  food 
recalls. 

Several  Harvard  scores  shown  in  Table  4-19  misestimate  the  proportion  who  are 
below  the  RDA  for  these  nutrients.  Among  women,  substantially  too  few  women  are 
detected  as  being  low  in  calcium  intake  (78%  by  diet  recall  V5.  34%  by  manual  score)  and 
substantially  too  many  are  estimated  to  be  low  in  protein  (17%  V5.  72%).  The  proportion 
'failing"  on  iron  (Grain  Products)  is  somewhat  overestimated  by  the  Harvard  score,  while 
vitamins  C  and  A  are  within  ±10%  of  the  correct  proportions,  in  women.  In  the  Block 
manual  score,  for  women,  too  few  'fail"  the  manual  score  initial  cutpoints  for  iron  (55% 
vs.  78%)  and  vitamin  A  (  40%  vs.  61%);  the  other  three  nutrients  are  within  ±10%. 

Among  children,  all  of  the  Harvard  scores  fail  to  estimate  the  correct  proportion 
by  10%  or  more,  in  some  cases  substantially:  whereas  0%  of  children  had  less  than  the 
RDA  for  protein  in  the  diet  recalls,  25%  of  children  'fail"  on  the  Harvard  Dairy  Score; 
87%  'failed"  on  the  Harvard  Grain  Products  score;  64%  of  children  'fail"  on  the  Harvard 
Meat  score,  and  the  combination  of  Meat  and  Grains  scores  did  not  improve  results.  In 
the  other  direction,  the  proportion  of  children  with  inadequate  calcium  was  substantially 
underestimated  (72%  vs.  25%)  by  the  Harvard  Dairy  Products  score.  The  Block  initial 
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Table  4-19 

Percent  Failing  FFQ  Manual  Score  and  Percent  <100%  of  the  RDA 

by  Nutrient  for  All  Women  and  Children 

All  numbers  are  percents 

Harvard 

Block  * 

Diet 

Failed  FFQ 

Percentage 

Diet 

Failed  FFQ 

Percentage 

Kecall 

Manual 

Point 

Recall 

Manual 

Point 

Nutrient 

<RDA 

Score 

<RnA 

Score 

Difference 

All  Women 

Protein 

17 

72 

55 

23 

15 

8 

Vitamin  A 

64 

66 

2 

61 

40 

21 

Vitamin  C 

32 

39 

7 

32 

24 

8 

Iron 

72 

83 

11 

78 

55 

23 

Calcium 

78 

34 

44 

75 

74 

1 

Children 

Protein 

0 

64 

64 

0 

2 

2 

Vitamin  A 

25 

70 

45 

29 

43 

14 

Vitamin  C 

22 

32 

10 

16 

38 

22 

Iron 

51 

87 

36 

55 

63 

8 

Calcium 

72 

25 

47 

63 

58 

5 

*  Block  initial  outpoints  used. 

cutpoints  overestimated  the  proportion  of  children  with  low  intakes  of  vitamin  C  (38%  vs. 
16%)  and  vitamin  A  (43%  vs.  29%),  while  the  other  three  nutrients  were  within  ±10%. 

Note  again,  that  while  the  Harvard  scores  were  developed  as  eligibility  criteria, 
they  were  not  intended  to  be  keyed  to  the  nutrients  they  are  compared  to  in  this 
discussion,  but  to  servings  of  foods  For  some  of  the  Harvard  food  groups  a  direct 
comparison  to  nutrients  seems  quite  relevant,  eg,  Dairy  Products  and  calcium,  or  Meat 
Products  and  protein.  On  the  other  hand,  using  iron  as  the  criterion  nutrient  for  the  Grain 
Products  group  may  be  less  appropriate.  While  iron  was  most  highly  associated  with  the 
Grain  Products  group  among  the  nutrients  considered,  other  reasons  to  count  or 
encourage  Grain  Products  might  include  dietary  fiber,  or  percent  of  energy  ft^om 
carbohydrates. 
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For  the  Block  Score,  it  is  also  worth  noting  that  since  the  scores  are  continuous 
variables,  the  cutpoints  can  be  adjusted  to  reflect  accurately  the  proportion  below  a 
particular  nutrient  RDA  in  the  WIC  population. 

One  assessment  of  the  dichotomized  scores  involves  examining  whether  the  actual 
nutrient  intake  as  measured  by  the  diet  recall  data  is  significantly  higher  in  the  '^ass" 
group  than  in  the  'fail"  group.  Table  4-20  shows  these  analyses  for  women  and  Table  4- 
21  for  children.    The  Harvard  '^ass/fail"  categorizations  are  compared  with  the  same 
nutrients  shown  in  the  previous  table.     The  Block  nutrient  scores  are  shown  for 
above/below  the  initially  proposed  cutpoints.    Among  women  in  Table  4-20,  persons 
identified  as  'failing"  a  score  did  indeed  have  lower  intakes  of  the  relevant  nutrient  than 
those  who  did  not  for  both  FFQs.    (In  this  analysis  a  significant  p-value  indicates  a 
successful  discrimination  between  groups  with  low  and  high  intake.)  The  difference  in  the 
mean  nutrient  intake  by  diet  recall  was  significantly  different  (p  <  0.05)  in  the  pass  and  fail 
groups  for  all  five  nutrients  by  the  Block  score,  and  for  one  of  the  nutrients  by  the  Harvard 
score,  although  three  additional  Harvard  food  group/nutrient  comparisons  approached 
significance. 

Among  children  in  Table  4-21,  neither  FFQ  manual  score  succeeded  in 
documenting  statistically  significant  differences  in  mean  nutrient  intake  by  diet  record,  for 
any  nutrient.  In  part,  this  failure  to  attain  statistical  significance  is  related  to  the  smaller 
sample  sizes  in  children  compared  with  women.  Persons  who  'failed"  each  of  these  scores 
did  tend  to  have  lower  diet  recall  nutrient  intake  (with  the  exception  of  the  Block  calcium 
score  for  children).  The  Harvard  score  approached  significance  for  calcium  (p  =  0.06)  and 
vitamin  A  (p  =  0.09).  The  Block  score  approached  significance  for  protein  (p  =  0.07). 

Examination  of  these  data  after  exclusion  of  FFQ  outliers  did  not  alter  any  of  these 
conclusions.  As  noted  above,  the  Harvard  scores  were  not  designed  to  reflect  nutrient 
intake  exactly.  For  the  Block  scores,  fijrther  exploration  of  cutpoints  or  food  items  to  be 
included  or  excluded  from  the  score  might  improve  these  results. 
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Table  4-20 

Comparison  of  Mean  Diet  Recall  Intake  by  Manual  Score 

for  All  Women  by  FFQ  Type* 

Harvard 

Block 

Fail  Pass 

Fail  Pass 

Meats, 

Mean 

Protein 

Mean 

Etc. 

Protein 

79  82 

Score 

Protein 

65  82 

(mg) 
n 

170  65 

(mg) 
n 

34  200 

p 

0.41 

P 

Vegetables 

Mean 
Vitamin  A 

838  969 

Vitamin  A 
Score 

Mean 
Vitamin  A 

782  974 

(RE) 
n 

155  80 

(RE) 
n 

95  139 

P 

0.06 

P 

Fruits 

Mean 

vitanfiin  u 

Mean 

Vitamin  C 

114  133 

Score 

Vitamin  C 

90  125 

(mg) 
n 

91  144 

(mg) 
n 

55  179 

P 

0.07 

P 

<0  01 

Grain 

Mean 

Iron 

Mean 

Products 

Iron 

14.2  15.9 

Score 

Iron 

13.5  15.2 

(mg) 
n 

795  40 

(mg) 
n 

129  105 

P 

0.06 

P 

<0.05 

Milk 

Mean 

Calcium 

Mean 

Products 

Calcium 

687  975 

Score 

Calcium 

840  1,047 

(mg) 
n 

81  154 

(mg) 
n 

174  60 

P 

<0.01 

P 

<0.01 

*    A  p-value  <0.05  would  indicate  that  a  manual  score  could  successfully  identify  a  group 
of  subjects  (those  who  "fail")  whose  nutrient  intake  was  significantly  lower  than  those 
who  did  not  "fail  - 
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Table  4-21 


Comparison  of  Mean  Diet  Recall  Intake  by  Manual  Score 
for  Children  by  FFQ  Type* 


Harvard 

Block 

Fail 

Pass 

Fail 

Pass 

Mean 

Protein 

Mean 

Protein 

46 

50 

Score 

Protein 

33 

52 

(mg) 

(mg) 

n 

60 

34 

n 

2 

85 

P 

0.26 

P 

0.07 

Vegetables     Mean  Vitamin  A  Mean 

Vitamin  A  606        729  Score      Vitamin  A      582  614 

(RE)  (RE) 

n  71  23  n  37  50 

p  0.09  p  0.58 


Fruits        Mean  Vitamin  C  Mean 

Vitamin  C  72  78  Score      Vitamin  C       76  84 

(mg)  (mg) 

n  30  64  n  33  54 

p  0.53  p  0.40 


Grain 
Products 


Mean 
Iron 
(mg) 

n 

P 


10.0 

82 


11.1 

12 


0.33 


Iron 
Score 


Mean 
Iron 
(mg) 

n 

P 


9.9 

55 


10.9 

32 


0.20 


Milk  Mean 
Products    Calcium       592  711 
(mg) 

n  23  71 

p  0.06 


Calcium  Mean 
Score      Calcium       755  757 
(mg) 

n  50  37 

p  0.97 


A  p-value  <0.05  would  indicate  that  a  manual  score  could  successfully  identify  a  group 
of  subjects  (those  who  "fail")  whose  nutrient  intake  was  significantly  lower  than  those 
who  did  not  "fail." 


WIC  Dietary  Assessment  Validation  Study 
Final  Report  -  September  22,  1994 
Page  4-55 


For  the  Block  manual  score,  it  is  also  possible  to  examine  the  actual  nutrient  intake 
not  just  within  dichotomous  pass/fail  categories  but  also  within  quartiles  of  the  manual 
scores.  These  are  shown  in  Table  4-22  for  All  Women  and  Table  4-23  for  children. 

It  can  be  seen  in  Table  4-22  that  among  women  there  is  a  clear  relationship 
between  the  Block  manual  score  and  the  associated  nutrient.  In  general,  for  both  means 
and  medians,  there  is  a  linear  relationship  of  increasing  diet  recall  mean  nutrient  with 
increasing  manual  score  quartile.  Among  children,  however,  that  is  not  the  case  (see 
Table  4-23).  The  children's  mean  diet  recall  nutrient  tends  to  be  somewhat  higher  in  the 
fourth  than  in  the  first  quartile,  but  even  that  is  not  true  when  medians  are  examined,  and 
there  is  no  clearly  linear  relationship  as  there  is  among  women. 

Criterion  III  -"Select  fi-om  a  range  of  cut-points" 

WIC  State  agencies  require  that  any  scoring  system  provide  a  degree  of  flexibility 
so  that  they  may  vary  the  criterion  and  thus  the  proportion  of  a  population  that  will  be 
certified  as  eligible.  The  flexibility  afforded  by  the  two  scoring  systems.  Harvard  and 
Block,  is  different.  For  the  Harvard  manual  score,  criteria  for  determining  eligibihty  can 
be  varied  by  requiring  that  one,  two,  or  more  of  the  food  group  scores  must  be  deemed 
inadequate."  For  the  Block  manual  score,  criteria  for  determining  eligibility  can  be  varied 
by  varying  the  position  of  the  cutpoint  on  any  one  of  the  nutrient  scores. 

If  the  scoring  systems  in  general  are  reflective  of  intake,  then  WIC  clinics  could 
choose  the  affordable  proportion  who  would  be  WIC-eligible,  by  choosing  different 
possible  cut-points  or  decision  criteria  of  the  two  instruments.  Tables  4-24  (Harvard 
women  and  children),  4-25  (Block  women)  and  4-26  (Block  children)  show  the 
proportion  of  the  WIC  subjects  in  the  present  study  population  who  would  be  deemed 
eligible  by  the  possible  criteria  of  the  two  instruments. 
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Table  4-22 

Mean  Recall  Nutrients  within  Quartile  of  Manual  Block  FFQ  Score 

for  All  Women 

Block  FFQ 

Recall 

Score  Category 

Nutrient 

Quartile 

Median 

Mean 

sd 

Protein 

Protein 

Q  1 

67.8 

70.7 

25.0 

(gm) 

Q2 

71.6 

72.0 

20.7 

Q3 

78.2 

81.2 

26.6 

Q4 

88.1 

93.8 

30.5 

Vitamin  A 

Vitamin  A 

Q  1 

566 

728 

528 

(RE) 

Q2 

857 

924 

496 

Q3 

805 

940 

466 

Q4 

814 

962 

518 

Vitamin  C 

Vitamin  C 

Q  1 

71.4 

90.5 

62.6 

(mg) 

Q2 

85.1 

112.6 

70.2 

Q3 

112.7 

131.1 

70.1 

Q4 

126.7 

133.5 

65.2 

iron 

Iron 

Q1 

11.2 

12.3 

4.7 

(mg) 

Q  2 

13.8 

14.4 

4.6 

Q3 

14.4 

14.7 

6.0 

Q4 

14.5 

15.6 

6.1 

Calcium 

Calcium 

Q  1 

606 

699 

366 

(mg) 

Q2 

803 

831 

336 

Q3 

947 

995 

427 

Q4 

1076 

1069 

388 
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Table  4-23 

Mean  Recall  Nutrients  within  Quartile  of  Manual  Block  FFQ  Score 

for  Children 

Block  FFQ  Recall 

Score  Category    Nutrient          Quartile     Median       Mean  sd 

Protein 

Protein 

0  1 

53.1 

52.6 

15.3 

(gm) 

Q  2 

46.5 

49.6 

17.5 

Q  3 

49.9 

51.2 

12.7 

Q4 

55.8 

54.3 

13.0 

Vitamin  A 

Vitamin  A 

Q  1 

520 

605 

310 

(RE) 

Q  2 

572 

545 

243 

Q  3 

567 

605 

214 

04 

511 

638 

286 

Vitamin  C 

Vitamin  C 

Q  1 

81.8 

82.5 

48.4 

(mg) 

Q2 

73.1 

73.3 

29.1 

03 

82.2 

86.5 

34.3 

04 

70.5 

82.6 

45.8 

Iron 

Iron 

0  1 

10.4 

10.4 

4.1 

(mg) 

02 

9.1 

9.6 

3.1 

0  3 

9.7 

10.2 

3.2 

04 

9.2 

10.9 

4.1 

Calcium 

Calcium 

0  1 

758 

766 

307 

(mg) 

02 

729 

762 

286 

03 

691 

720 

234 

04 

715 

784 

273 
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Table  4-24 

Harvard  FFQ 

Varying  Criteria  and  Proportion  Who  "Fail" 

for  All  Women  and  Children 

All  Women 

Percent 

Cumulative  Percent 

Possible  Decision  Criteria 

Who  Fail 

Failing 

Fail  none 

4.3 



Fail  exactly  one  score 

12.8 

12.8 

Fail  exactly  two  scores 

21.7 

34.5 

Fail  exactly  three  scores 

23.8 

58.3 

Fail  exactly  four  scores 

20.4 

78.7 

Fail  exactly  all  scores 

17.0 

95.7 

Children 

Percent 

Cumulative  Percent 

Possible  Decision  Criteria 

Who  Fail 

Failing 

Fail  none 

5.3 

Fail  exactly  one  score 

14.9 

14.9 

Fail  exactly  two  scores 

16.0 

30.9 

Fail  exactly  three  scores 

27.7 

58.6 

Fail  exactly  four  scores 

27.7 

86.3 

Fail  exactly  all  scores 

8.5 

94.8 
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Table  4-25 
Block  FFQ 

Varying  Criteria,  and  Proportion  Who  "Fail" 
for  All  Women 


Possible 

Protein 

Vitamin  A 

Vitamin  C 

iron 

Calcium 

Decision 

Score 

Score 

Score 

Score 

Score 

Criteria 

Score 

% 

Cum.  % 

% 

Cum.  % 

% 

Cum.  % 

% 

Cum.  % 

% 

Cum. 

Cutpoints 

0-5 

5.1 

5.1 

7.7 

7.7 

12.8 

12.8 

6.4 

6.4 

7.3 

7.3 

6 

1.7 

6.8 

1.3 

9.0 

5.1 

17.9 

2.1 

8.5 

0.4 

7.7 

7 

2.6 

9.4 

3.8 

12.8 

5  6 

23.5 

1.3 

9.8 

O  A 

3.4 

A  A  A 

11.1 

8 

1.7 

11.1 

5.6 

18.4 

6.0 

29.5 

3.0 

12.8 

C  A 

5.1 

16.2 

9 

3.4 

14  5 

3.0 

21.4 

8. 1 

37.6 

A  O 

4.3 

17.1 

7.3 

23.5 

10 

6.0 

20.5 

/.3 

28. o 

9.0 

46.6 

1.7 

'too 
18.8 

4.3 

27.8 

1 1 

4.7 

25.2 

5.1 

33.8 

4.7 

51.3 

5.1 

23.9 

5.1 

32.9 

12 

4.7 

29.9 

6.8 

406 

56 

56.8 

3.4 

27.4 

4.3 

37.2 

13 

6.8 

36.8 

7.7 

48  3 

6.4 

63.2 

8.1 

35.5 

7.3 

44.4 

14 

5.6 

42.3 

3.8 

52.1 

6.0 

69.2 

6.0 

41.5 

9.8 

54.3 

15 

5.6 

47.9 

3.8 

56.0 

7  7 

76.9 

6.4 

47.9 

5.6 

59.8 

16 

6.4 

54.3 

5.1 

61.1 

4.3 

81.2 

7.3 

55.1 

8.1 

67.9 

17 

8.1 

62.4 

3.8 

65.0 

3,4 

84.6 

5.1 

60.3 

3.8 

71.8 

18 

4.3 

66.7 

34 

68.4 

3.8 

88.5 

5.1 

65.4 

3.8 

75.6 

19 

5.1 

71.8 

7.3 

75.6 

2.1 

90.6 

3.8 

69.2 

6.0 

81.6 

20 

3.4 

75.2 

5.6 

81  2 

2.6 

93.2 

5.1 

74.4 

4.3 

85.9 

21 

6.0 

81.2 

2.6 

838 

0.9 

94.0 

3.8 

78.2 

3.8 

89.7 

22 

2.1 

83.3 

2.6 

86  3 

0.4 

94.4 

2.6 

80.8 

0.9 

90.6 

23 

2.6 

85.9 

3.0 

89  3 

17 

96.2 

0.9 

81.6 

0.9 

91.5 

24 

2.1 

88.0 

1.7 

91  0 

0.9 

97.0 

2.6 

84.2 

1.7 

93.2 

25 

1.3 

89.3 

1.7 

92  7 

04 

97.4 

3.4 

87.6 

1.7 

94.9 

26  or  more 

10.7 

100.0 

7.3 

100  0 

2  5 

100.0 

12.4 

100.0 

5.1 

100.0 
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Table  4-26 


Block  FFQ 

Varying  Criteria,  and  Proportion  Who  "Fail" 
for  Children 


Protein 

Vitamin  A 

Vitamin  C 

Iron 

Calcium 

Score 

Score 

Score 

Score 

Score 

0 11  ic  11  a 

Score 

% 

Cum.  % 

% 

Cum.  % 

% 

Cum.  % 

% 

Cum.  % 

% 

Cum. 

0-5 

2.3 

2.3 

2.3 

2.3 

14.9 

14.9 

2.3 

2.3 

5.7 

5.7 

6 

2.3 

4.6 

2.3 

4.6 

6.9 

21.8 

2.3 

4.6 

1.1 

6.9 

7 

3.4 

8.0 

4.6 

9.2 

6.9 

28.7 

3.4 

8.0 

4.6 

11.5 

8 

1.1 

9.2 

2.3 

11.5 

9.2 

37.9 

5.7 

13.8 

4.6 

16.1 

9 

1.1 

10.3 

6.9 

18.4 

10.3 

48.3 

5.7 

19.5 

2.3 

18.4 

10 

4.6 

14.9 

3.4 

21 .8 

8.0 

56.3 

5.7 

25.3 

11.5 

29.9 

11 

6.9 

21.8 

4.6 

26.4 

2.3 

58.6 

4.6 

29.9 

4.6 

34.5 

12 

3.4 

25.3 

3.4 

29.9 

4.6 

63.2 

3.4 

33.3 

5.7 

40.2 

13 

3.4 

28.7 

4.6 

34.5 

8.0 

71.3 

4.6 

37.9 

5.7 

46.0 

14 

8.0 

36.8 

8.0 

42.5 

10.3 

81.6 

3.4 

41.4 

3.4 

49.4 

15 

6.9 

43.7 

6.9 

49.4 

4.6 

86.2 

5.7 

47.1 

3.4 

52.9 

16 

4.6 

48.3 

5.7 

55.2 

2.3 

88.5 

5.7 

52.9 

4.6 

57.5 

17 

5.7 

54.0 

2.3 

57.5 

1.1 

89.7 

5.7 

58.6 

4.6 

62.1 

18 

0.0 

54.0 

2.3 

59.8 

0.0 

89.7 

4.6 

63.2 

5.7 

67.8 

19 

6.9 

60.9 

6.9 

66.7 

3.4 

93.1 

3.4 

66.7 

10.3 

78.2 

20 

2.3 

63.2 

5.7 

72.4 

2.3 

95.4 

3.4 

70.1 

6.9 

85.1 

21 

9.2 

72.4 

9.2 

81.6 

2.3 

97.7 

4.6 

74.7 

2.3 

87.4 

22 

2.3 

74.7 

0.0 

81.6 

1.1 

98.9 

4.6 

79.3 

4.6 

92.0 

23 

3.4 

78.2 

2.3 

83.9 

1.1 

100.0 

2.3 

81.6 

2.3 

94.3 

24 

3.4 

81.6 

2.3 

86.2 

3.4 

85.1 

1.1 

95.4 

25 

2.3 

83.9 

4.6 

90.8 

3.4 

88.5 

1.1 

96.6 

26  or  more 

16.1 

100.0 

9.1 

100.0 

11.5 

100.0 

3.4 

100.0 
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Manual  Scoring  Discussion  and  Conclusions 

Instructions  for  the  Harvard  manual  score  suggest  that  scoring  can  stop  and  an 
eligibility  decision  can  be  reached  as  soon  as  any  food  group  score  is  'failed."  That 
approach,  however,  is  not  useful  for  the  WIC  situation  for  the  following  reasons: 

•  Virtually  all  respondents  fail  and  would  be  declared  eligible,  thus  affording 
WIC  no  flexibility  in  the  proportion  of  clients  served; 

•  It  cannot  select  correctly  the  5%  of  respondents  who  do  not  fail;  and 
Different  instructions  that  allow  more  flexibility,  such  as  'Eligible  if  two  food 

groups  fail,"  'Eligible  if  three  food  groups  fail,"  etc.,  were  shown  above  in  Tables  4-24 
through  4-26  with  the  proportion  who  would  be  eligible  by  those  definitions.  The  Block 
score,  by  its  design,  allows  for  a  wide  range  of  flexibility. 

Scores  may  also  be  judged  by  whether  the  study  subjects  who  'fail"  do  indeed 
have  lower  nutrient  intake  than  those  who  do  not.  These  were  shown  in  Table  4-19,  for 
the  Harvard  scores  and  the  Block  initial  cutpoints.  For  women,  all  five  Block  scores 
differentiated  pass/fail  groups  whose  intakes  were  significantly  different  statistically;  only 
one  of  the  Harvard  scores  did  so  at  the  p  <  0.05  level.  Table  4-22  quartiles  show  that 
higher  and  lower  levels  of  the  Block  score  are  associated  with  fiarther  differentiation 
among  groups  with  high  and  low  intake. 

Among  children  neither  manual  score  cutpoint  was  successful.  If  validity 
correlations  for  children  can  be  improved,  it  may  also  be  possible  to  improve  the 
performance  of  the  Block  manual  scoring  system. 

Thus,  in  terms  of  validity,  flexibility,  and  the  ability  to  distinguish  between  groups 
with  lower  or  higher  nutritional  intake,  the  Block  manual  scoring  system  performed  better. 
Improved  pass/fail  cutpoints  for  women  have  already  been  identified  (Appendix  E-1). 
Further  modifications  might  improve  the  score  for  children. 
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4.7      FFQ  FOOD  GROUPS 


Analytic  Approaches 

The  two  FFQs  were  compared  with  each  other  with  respect  to  their  estimates  of 
the  frequency  of  consumption  of  nine  food  groups  of  interest.  In  addition,  the  USDA 
Food  Guide  Pyramid  recommendations  are  shown,  for  comparison.  Food  group  data  are 
not  obtainable  from  the  Minnesota  Nutrient  Data  System  (NDS),  and  thus  a  direct 
comparison  of  these  estimates  with  the  reference  data  was  not  possible.  However,  for 
some  food  groups  an  internal  comparison  between  the  accuracy  of  the  relevant  nutrient 
estimate  and  the  food  group  estimate  was  considered. 

Comparisons  with  published  frequency  estimates  from  other  national  data  sets 
were  not  performed,  but  the  strengths  and  weaknesses  of  such  comparisons  are  discussed. 

Food  Group  Definitions 

Harvard  FFQ.  It  was  not  possible  to  locate  any  software  documentation 
regarding  the  exact  food  items  that  are  included  in  the  food  groups  for  the  Harvard  food 
group  count.  As  noted  in  the  Harvard  1992  report  (Gardner  et  al.,  1992),  instruments 
may  vary  widely  in  the  foods  included  in  a  group.  Listed  below  are  the  number  of 
potentially  relevant  items  on  the  Harvard  questionnaire,  including  all  those  also  counted  by 
the  Block  software  as  being  in  that  group  (e.g.,  pizza  in  dairy  group).  This  is  not 
necessarily  the  number  that  the  Harvard  software  counts  in  that  group. 

•  Milk,  yogurt  and  cheese  group.   6  potential  items.   (Ice  cream  and  pudding 
also  asked.) 

•  Fruit  and fruit  juice  group.  12  potential  items. 

•  Vegetables  group.  16  potential  items. 

•  Bread,  cereal,  rice  &  pasta  group.  12  potential  items.  (This  does  not  include 
donuts  or  sweet  rolls.) 

•  Meat  etc.  group.  16  potential  items  (counting  same  types  of  items  as  in  Block 
meat  group). 


WIG  Dietary  Assessment  Validation  Study 
Final  Report  -  September  22,  1994 
Page  4-63 


•  Foods  rich  in  vitamin  A.  10  potential  items.  (Choice  of  foods  to  include  in  a 
group  such  as  this  is  quite  arbitrary.  Only  foods  directly  parallel  to  those 
included  in  the  Block  vitamin  A  group  are  counted  here.) 

•  Foods  rich  in  vitamin  C.  4  potential  items.  (Choice  of  foods  to  include  in  a 
group  such  as  this  is  quite  arbitrary.  Only  foods  directly  parallel  to  those 
included  in  the  Block  vitamin  C  group  are  counted  here) 

•  Sweets.  12  potential  items. 

•  Fats.  2  potential  items.  Again,  choice  of  items  is  somewhat  arbitrary. 

Block  FFQ.  Food  groups  in  the  Block  software  can  be  defined  to  include  any  set 
of  foods  chosen  by  the  investigators.  Thus,  the  groups  could  be  defined  in  any  way 
desired.  For  example,  'Foods  rich  in  vitamin  A"  could  be  defined  to  include  or  exclude 
peaches.  The  definition  of  the  food  groups  used  in  the  present  analysis  is  shown  below, 
and  includes  the  food  group  inclusions  that  are  the  defaults  in  the  software,  and  represents 
foods  included  in  the  'Pyramid"  groups.  Only  foods  used  on  the  Block  WIC  FFQ  are 
shown. 

•  Milk,  yogurt  and  cheese  group.  7:  Whole  milk,  lowfat  milk,  cheese  and  cheese 
spread,  macaroni  and  cheese,  pizza,  yogurt  or  frozen  yogurt,  milk  on  cereal. 

•  Fruit  and  fruit  juice  group.  7;  "Apples,  grapes  or  any  other  fiiiit,"  bananas, 
peaches  or  cantaloupe,  oranges,  orange  juice,  apple  or  grape  juice,  baby  food 
fiiiit  (child's  FFQ  only). 

•  Vegetables  group.  12:  Tomatoes,  broccoli,  greens  or  spinach,  coleslaw  or 
cabbage,  carrots,  green  salad,  sweet  potatoes  or  yams,  potatoes  including 
French  fiies,  other  vegetables,  beef  stew,  vegetable  soup,  cooked  green 
peppers  or  chile  rellenos. 

•  Bread,  cereal,  rice  &  pasta  group.  12:  Bread  including  sandwiches, 
combread,  com  tortillas,  flour  tortillas,  biscuits  or  muffins,  rice,  spaghetti  with 
sauce,  pizza,  macaroni  and  cheese,  cold  cereals,  cooked  cereals  or  grits, 
hamburgers  (rolls).  This  intentionally  does  not  include  pastries  and  similar 
high-fat  or  high-sugar  grain  products. 
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•  Meat  etc.  group.  16:  Hamburgers,  beef,  beef  stew,  liver,  pork,  fried  chicken, 
other  chicken,  tuna,  fish,  hot  dogs,  lunch  meats,  eggs,  bacon  or  sausage,  dried 
type  beans,  chili  with  beans,  peanuts  or  peanut  butter. 

•  Foods  rich  in  vitamin  A.  7:  Greens  or  spinach,  carrots,  sweet  potatoes,  liver, 
cheese  or  cheese  spread,  macaroni  and  cheese,  eggs. 

•  Foods  rich  in  vitamin  C.  3:  Oranges,  orange  juice,  greens  or  spinach. 

•  Sweets.  6:  Ice  cream,  donuts  or  pastry,  chocolate  candy,  soft  drinks,  cake  or 
cookies,  and  sugar. 

•  Fats.  2:  Butter  or  margarine,  salad  dressing. 

FFQ  Food  Groups  Results 

The  data  shown  in  Table  4-27  are  for  FFQ-1  only,  that  is,  the  first  administration 
of  the  FFQ.  Further,  they  include  all  study  subjects  in  the  core  analyzed  data  set,  including 
those  whose  FFQ  results  were  thought  to  be  questionable  by  the  respective  FFQ  criteria. 
This  subset  is  the  one  most  relevant  to  the  usability  of  the  instruments  in  an  actual  WIC 
situation  where  dietary  assessment  is  most  frequently  performed  as  part  of  eligibility 
determination,  and  computer  scoring  and  edits  are  not  available. 

Comparisons  of  the  Two  FFQs  vyith  Each  Other  and  with  the  Pyramid  Recommendations. 

Milk.  Both  FFQs  overestimated  calcium  intake  consistently  (see  Section  4.5  on 
group  means).  Thus,  it  is  likely  that  both  estimates  of  the  Milk  food  group  are 
overestimates.  For  Harvard,  this  could  be  remedied  by  dropping  some  items,  or 
reformatting  to  eliminate  the  possibility  of  erroneously  high  estimates  for  the  individual 
foods.  For  the  Block  FFQ,  this  could  be  remedied  by  combining  Whole  milk  and  Lowfat 
milk  on  the  questionnaire,  as  the  presence  of  two  items  may  have  confused  some  in  this 
population. 

Fruit.  The  Harvard  FFQ  significantly  overestimated  vitamin  C  (see  Section  4.5  on 
group  means).  This  is  reflected  in  the  substantially  higher  estimate  of  fiaiit  by  Harvard 
than   Block.       Based    on    national    survey    data,    it    is    likely    that    both  are 
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Table  4-27 

Servings  per  Food  Group  and  USDA  Pyramid  Recommendations 
for  Harvard  and  Block  FFQ-1,  All  Cases  Included. 

(Mean  number  of  servings  +/-  sd) 

Food  Groups 

Estimated  Number  of  Servings 
Harvard  FFQ             Block  FFQ 

Pyramid 
Recommendation 

Meat,  Poultry,  Fish,  Beans, 

Eggs 

2.5  +/-2.37 

2.7+/- 2.4 

2+ 

Vegetables 

3.8  +/-  4.0 

2.5  +/-2.3 

3+ 

Foods  Rich  in  Vitamin  A 

1.0  +/-  1.34 

1.5  +/-  1.45 

na 

Fruit  and  Fruit  Juice 

4.1  +/-4.96 

2.0+/-  1.74 

2+ 

Foods  Rich  in  Vitamin  C 

1.8  +/-  1.95 

0.7  +/-  0.71 

na 

Bread,  Cereal,  Rice  and 
Pasta 

3.7  +/-  3.34 

3.2  +/-  2.0 

6+ 

Milk  &  Milk  Products 

3.0  +/-  2.29 

3.8  +/-  2.98 

2+ 

overestimates,  but  the  Harvard  overestimate  is  substantially  greater.  The  Harvard 
overestimate  could  be  moderated  by  reformatting,  as  described  above,  and  dropping  some 
items. 

Vegetables.  Both  FFQs  overestimate  vitamin  A  (see  Section  4.5  on  group  means). 
Thus,  it  is  likely  that  both  estimates  of  vegetable  consumption  are  overestimates.  Harvard 
more  so  than  Block. 

Bread,  pasta,  etc.  Harvard's  estimate  is  somewhat  higher  than  Block's.  The  Block 
FFQ  food  group  includes  rice  and  pasta  (as  does  the  Pyramid),  while  the  actual  foods 
comprising  the  Harvard  list  are  unknown.  Both  are  probably  underestimates  of  actual 
servings,  as  servings  are  defined  by  the  Pyramid.  This  is  because,  in  general,  the  food 
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group  scores  are  counting  instances  of  consumption  rather  than  half-cup  or  one-slice 
portions. 

Meat,  etc.  Both  FFQs  overestimate  protein  (see  Section  4.5  on  group  means). 
Harvard  more  so  than  Block  The  fact  that  Block's  food  group  estimate  is  higher  than 
Harvard's  above  may  reflect  that  Block's  group  includes  beans  and  eggs  (as  the  Pyramid 
does),  while  Harvard's  may  not.  The  actual  foods  that  comprise  Harvard's  group  are  not 
known. 

Foods  rich  in  vitamin  A.  Block's  food  group  estimate  is  higher  than  Harvard's,  but 
this  may  reflect  the  inclusion  in  the  Block  FFQ  count  of  liver,  cheese,  macaroni  and 
cheese,  and  eggs.  Whether  or  not  these  foods  are  included  in  the  Harvard  FFQ  count  is 
not  known,  but  it  is  likely  that  only  vegetable  sources  were  included.  As  noted  above,  for 
the  Block  FFQ  the  foods  to  be  included  in  a  food  group  count  may  be  defined  in  advance 
by  FNS  nutritionists. 

Foods  rich  in  vitamin  C.  Harvard's  food  group  estimate  is  higher  than  Block's,  but 
again  it  is  probably  a  function  of  the  foods  included  in  the  count. 

Comparisons  with  National  Surveys 

Comparisons  with  data  fi^om  NHANES  II  24-hour  diet  recall  data  have  many 
problems,  as  discussed  further  below  However,  they  provide  some  comparison  with 
national  detailed  data.  In  NHANES  11,  only  59%  of  the  population  ate  even  a  single 
serving  of  a  fhiit  or  fruit  juice.  This  would  suggest  that  a  low  mean  daily  fnait  intake  is 
closer  to  the  truth  than  a  high  one  The  average  number  of  servings  of  fruits  and 
vegetables  was  approximately  3  .5  Both  of  these  NHANES  II  estimates  tend  to  be  lower 
in  lower-income  persons. 

Similarly,  comparisons  with  CSFII  are  imperfect.  The  only  published  CSFII  data 
usable  for  this  purpose  give  the  percent  of  the  population  using  a  food  type  at  least  once 
in  four  days.  Among  low-income  women  19-50  years,  only  37.4%  used  any  milk  or  milk 
products  (including  milk,  cheese,  yogurt  and  other  items).  CSFII  data  are  not  presented 
separately  for  pregnant  or  lactating  women,  however,  and  you  would  expect  intake  in 
those  groups  to  be  higher.  In  CSFII,  only  91%  of  low-income  children  1-4  and  only  72% 
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of  low-income  women  consumed  any  fruit  or  fruit  juice  in  the  four  days,  suggesting  again 
that  lower  rather  than  higher  estimates  are  closer  to  the  truth. 

Food  Groups  Discussion 

Table  4-27  shows  that  the  mean  food  group  frequency  is  higher  by  the  Block  FFQ 
for  Milk  Products,  Meat  and  Foods  Rich  in  Vitamin  A.  It  is  higher  in  the  Harvard  FFQ  for 
Fruit,  Vegetables,  Bread  Products  and  Foods  Rich  in  Vitamin  C.  The  relevance  of  this 
observation  is  unclear,  since  the  food  group  frequency  depends  to  a  great  extent  on  the 
number  of  foods  included  in  the  group. 

The  USD  A  Food  Pyramid  suggests  consumption  of  2-4  servings  of  fhiit  and  3-5 
servings  of  vegetables.  Consumption  of  5  servings  of  fruits  and  vegetables  a  day  has  been 
estimated  to  provide  225-400  mg  of  vitamin  C  per  day  (Lachance  1992,  Patterson  1990). 
Since  the  intake  of  vitamin  C  in  this  WIC  population  is  substantially  below  that  level,  it 
would  seem  that  they  are  consuming  considerably  less  than  the  five  servings;  this  would  be 
consistent  with  other  national  data  indicating  poor  intakes  of  these  foods.  Again,  lower 
estimates  seem  closer  than  higher  estimates,  and  suggest  that  the  Block  estimates  are 
closer  to  reality.  The  Pyramid  recommends  six  or  more  servings  of  grain  products,  and 
both  instruments  suggest  considerably  less  than  that,  again  consistent  with  other  data. 

With  regard  to  comparisons  among  the  different  data  sources,  a  limitation  of  all 
comparisons  is  that  definitions  of  foods  to  be  included  in  the  groups  vary  across  the 
different  national  surveys  and  between  the  Harvard  and  Block  instruments.  Comparisons 
with  NHANES  II  or  CSFII  might  seem  to  have  the  merit  of  at  least  being  objective 
estimates  of  actual  intake.  However,  NHANES  II  refers  only  to  intake  in  the  prior  24 
hours,  whereas  the  FFQ  refers  to  intake  in  the  prior  month.  The  CSFII  four-day  data 
provide  better  'Usual"  intake  estimates  than  does  a  single  24-hour  diet  recall,  but 
published  data  are  only  available  for  some  of  the  food  groups.  And  like  a  24-hour  diet 
recall,  all  that  is  known  is  the  proportion  who  consumed  them  at  least  once  during  the  four 
days,  not  the  average  number  of  times  the  foods  were  consumed.  Thus,  none  of  these 
comparisons  provides  a  precise  evaluation  of  whether  or  not  the  FFQ  estimates  of  number 
of  servings  consumed  is  accurate. 
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Comparison  of  the  two  FFQs  with  food  group  estimates  from  food  frequency 
questionnaires  administered  to  national  samples,  such  as  the  1987  National  Health 
Interview  Survey  (NHIS)  or  the  National  Cancer  Institute's  Tive-a-day  Baseline  Survey" 
also  are  fraught  with  difficulties.  First,  such  comparisons  exaggerate  agreement  of  these 
FFQs  with  national  data,  because  the  national  data  are  of  the  same  form,  a  food  frequency 
questionnaire;  similarity  of  estimates  does  not  necessarily  mean  that  either  one  is  correct. 
Further,  an  examination  of  the  NHIS  and  Five-a-day  questionnaires  illustrates  the  problem 
of  comparing  numbers  of  servings  from  different  instruments.  The  estimates  from  the 
Five-a-day  survey  are  substantially  higher  than  those  from  the  NHIS  data,  in  large  part  a 
simple  result  of  the  numbers  of  foods  on  the  food  list.  NHIS  included  only  18  friiits  and 
vegetables,  while  Five-a-day  included  33  such  items.  Estimates  of  numbers  of  servings 
will  inevitably  vary  depending  on  the  number  of  items  asked  and  included  in  the  food 
group  estimate.  Inaccurately  low  estimates  of  numbers  of  servings  from  a  food  group  can 
be  remedied  by  increasing  the  number  of  foods  from  that  food  group  asked  on  the  FFQ. 
However,  inclusion  of  too  many  food  items  on  an  FFQ  does  not  necessarily  increase  the 
accuracy  of  the  estimate,  but  rather  may  lead  to  overestimates  of  the  number  of  servings 
consumed. 

Limitations  of  the  Usability  of  Food  Group  Estimates  from  the  FFQs 

For  both  FFQ  instruments,  the  computer  program  must  be  run  in  order  to  obtain 
the  estimate  of  number  of  servings  from  food  groups.  For  the  Harvard  FFQ,  this  would  be 
done  by  key-entering  the  FFQ  responses  into  WICENTER.  For  the  Block  FFQ,  this 
would  be  done  either  by  key-entering  or  with  a  scanner.  Both  instruments  produce  food 
group  estimates  in  the  printed  output.  Thus,  for  both  instruments  the  estimates  of  food 
group  servings  would  only  be  available  to  the  WIC  nutritionist  in  the  clinic  if  the 
instruments  are  computer-scored. 

For  purposes  of  data  aggregation  within  or  across  WIC  sites,  or  for  subsequent 
research,  the  Block  FFQ  produces  a  computer  file  with  the  food  group  count  on  it;  with 
the  Harvard  FFQ,  on  the  other  hand,  the  printed  output  would  itself  have  to  be  key- 
entered  in  a  second  keying  process  if  a  computer  file  of  food  group  results  were  desired. 
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Food  Group  Conclusions 

The  comparison  of  numbers  of  items  in  the  groups  noted  above,  combined  with  the 
examination  of  NDS  and  FFQ  group  means  (Section  4.5),  suggest  that  both  FFQs 
overestimate  intake  of  several  food  groups,  and  that  the  Harvard  FFQ  overestimates  to  a 
greater  extent  than  does  the  Block  FFQ.  To  some  extent  these  overestimates  could  be 
reduced  by  reducing  the  number  of  food  items  included  in  the  group  count,  particularly  for 
the  Harvard  FFQ.  However,  to  a  considerable  extent  the  Harvard  FFQ  overcount  is  a 
function  of  the  structure  of  the  FFQ  itself  by  permitting  study  subjects  to  indicate  a 
frequency  of  consumption  as  high  as  6+  times  per  day  for  all  foods,  errors  of  exaggeration 
are  inevitable  and  consistent.  A  substantial  reduction  in  Harvard's  overcount  would 
require  restructuring  the  frequency  categories  Other  improvements  are  possible  for  the 
Block  FFQ.  With  regard  to  milk  and  dairy  products,  the  Block  FFQ  instrument  for  WIC 
should  perhaps  not  include  two  line  items  for  fluid  milk,  as  that  may  have  confused  some 
study  subjects  and  led  to  double-counting. 


4.8      FFQ  USABILITY  ASSESSMENT  BY  WIC  AGENCIES 

Usability  Assessment  Results 

State  WIC  agencies  in  Delaware,  North  Dakota  and  Puerto  Rico  provided 
qualitative  assessments  of  the  Harvard  and  Block  FFQs.  The  questionnaires  were  used 
with  a  small  number  of  WIC  clients  in  each  state  and  FFQ  usability  issues  were  examined 
by  administering  staff.  The  assessment  was  structured  around  a  set  of  specific  questions 
relating  to  the  FFQ's  effectiveness  for  use  in  nutrition  education,  use  in  determining  WIC 
eligibility,  ease  of  use,  etc.  A  summary  of  usability  assessment  results  is  described  in  this 
section. 

Usefulness  for  Nutrition  Education 

The  WIC  agency  nutritionists  who  were  queried  indicated  that  both  FFQs  were 
generally  useful  in  collecting  dietary  assessment  information  that  was  helpful  in  providing 
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nutrition  education  to  WIC  clients.  Some  believed  that  the  Harvard  FFQ  food  groupings 
related  better  to  WIC  eligibility  criteria  and  nutrition  education  models  such  as  the  'food 
pyramid."  Although  the  Block  FFQ  is  also  organized  by  types  of  foods,  the  WIC  staffs 
generally  preferred  the  Harvard  manual  score  results  which  give  a  simple  pass-fail  on  each 
food  group,  which  relate  more  closely  to  commonly-used  nutrition  education  food  groups. 
The  Block  portion  quantity  question  regarding  'how  much  each  time"  proved  useful  for 
discussing  portion  sizes  with  clients. 

Manual  Scoring  Systems 

In  general,  all  three  participating  agencies  found  the  Block  FFQ  manual  scoring 
system  quick  and  easy  to  use  whereas  the  Harvard  scoring  system,  using  overlays,  was 
described  as  'fcumbersome,"  'fconflising,"  'time-consuming,"  and  'bverwhelming  to  the 
professional."  On  the  other  hand,  they  liked  Harvard's  easy,  pass-fail  system  for  rating 
each  food  group.  Having  the  entire  scoring  system  printed  on  the  right-hand  column  of 
the  Block  FFQ  was  perceived  as  advantageous  over  having  to  keep  track  of  three  separate 
scoring  templates.  One  evaluation  noted  that  it  would  be  preferable  if  the  range  of  scoring 
values  were  consistent  throughout  the  Block  FFQ  (two  sets  of  values  are  used  on  page  4) 
Several  WIC  staff  suggested  that  computerized  scoring  systems  might  be  preferable  to 
either  of  the  manual  approaches. 

Overall,  Harvard  and  Block  scores  were  both  perceived  as  useful  for  determining 
eligibility.  However,  the  evaluating  WIC  staff  questioned  the  reliability  and  accuracy  of 
both  FFQs.  One  respondent  suggested  including  an  interpretation  of  scores  at  the  end  of 
the  Block  FFQ.  Another  praised  the  ease  of  using  the  Harvard  pass-fail  food  group 
results,  but  questioned  the  accuracy  of  the  Harvard  scores  because  they  seem  to  allow 
almost  all  clients  to  qualify.  It  was  thought  that  the  Harvard  food  groupings  relate  better 
to  WIC  eligibility  criteria  than  those  of  the  Block  instrument  and  also  that  the  Harvard 
pass-fail  scores  are  more  easily  understood  by  clients. 
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Use  by  WIC  Clients 

The  three  evaluating  agencies  expressed  very  mixed  opinions  as  to  which  FFQ  type 
was  easier  to  use  by  WIC  clients.  However,  there  was  some  agreement  about  desirable 
characteristics.  Both  FFQs  were  seen  as  relatively  easy  to  read  and  use.  There  was 
consensus  that  having  a  sample  question,  as  in  the  Block  FFQ,  was  very  useful  in  helping 
orient  a  client  to  the  instrument.  Again,  some  thought  the  food  groupings  in  the  Harvard 
FFQ  were  more  logical  and  made  more  sense  to  clients  and  WIC  staff.  It  was  agreed  that 
the  FFQs  should  be  as  short  as  possible  and  there  was  concern  expressed  about  the  length 
and  complexity  of  both  Harvard  and  Block  FFQs  Some  reviewers  said  that  the  Block 
portion  question  about  how  much  of  each  item  was  consumed  each  time  —  small, 
medium,  or  large  —  was  ambiguous  and  confusing  to  some  clients.  Others  liked  the 
assessment  of  children's  portion  sizes  in  the  Block  FFQ  which  asks  how  much  each  time 
"compared  to  other  children." 

In  general,  both  Harvard  and  Block  FFQs  were  cited  as  being  graphically  clear, 
simple  and  easy-to-read.  The  use  of  shading  for  food  item  lines  and  frequency  columns  in 
both  instruments  was  noted  as  aiding  usability.  It  was  also  considered  advantageous  that 
both  FFQs  ask  users  only  to  check  boxes  as  opposed  to  writing  out  responses. 

FFQ  Administration  bv  WIC  Staff 

A  concern  with  both  FFQs  was  the  amount  of  time  needed  to  instruct  clients  on 
how  to  complete  the  questionnaires  Even  after  explanations,  some  clients  were  confused 
about  how  to  proceed  or  complete  the  FFQ  Staff  valued  having  a  sample  question  for 
demonstration  purposes  included  at  the  start  of  the  Block  FFQ.  As  noted,  most  staff 
preferred  the  simpler  Block  scoring  system  to  the  Harvard,  finding  it  easier  to  score  and 
taking  less  time. 

Cultural  Suitability 

The  evaluating  WIC  staff  thought  that  both  FFQs  were  suitable  for  use  with 
African  Americans,  Hispanics  and  Whites.  However,  the  Puerto  Rico  WIC  program 
expressed  serious  concern  about  the  applicability  of  either  FFQ  for  use  with  its  all- 
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Hispanic,  Spanish-speaking  population.  It  was  reported  that  Puerto  Rican  clients  were 
confused  about  how  to  use  and  complete  the  FFQs  and  did  not  understand  general 
questions  about  frequencies  and  quantities.  Furthermore,  many  of  the  food  terms  in 
Spanish  are  not  used  nor  understood  in  Puerto  Rico.  The  diversity  of  Hispanic  food  terms 
suggests  that  it  may  be  difficult  to  utilize  only  one  version  of  a  Spanish-language  FFQ  with 
all  Hispanic  groups. 

Assessment  Summary 

Overall,  the  three  participating  WIC  agencies  who  were  queried  for  their  opinions 
about  usability  thought  that  both  FFQs  proved  generally  useful  in  collecting  dietary 
assessment  information  and  assisting  in  nutrition  education.  The  validity  for  using  these 
FFQs  to  determine  eligibility  was  questioned  and  some  WIC  staff  thought  that  it  may  be 
more  effective  and  less  time-consuming  to  collect  diet  recalls.  Neither  FFQ  worked  well 
with  the  Puerto  Rican  WIC  population  for  a  variety  of  cultural  reasons. 

Reviewers  preferred  to  have  a  manual  scoring  system  incorporated  into  the 
instrument  as  in  the  Block  FFQ  and  disliked  having  to  use  the  separate  Harvard  scoring 
templates.  On  the  other  hand,  they  preferred  to  have  easy-to-interpret  scores,  as  with  the 
Harvard  instrument,  that  relate  to  commonly  perceived  food  groups. 

The  structure  and  logic  related  to  constructing  food  frequency  questionnaires  may 
not  be  obvious  to  WIC  staff.  Some  participating  in  the  assessment  were  puzzled  by  the 
selection  of  specific  food  items  included  in  the  FFQs,  feeling  that  they  did  not  seem  to  be 
representative.  They  also  questioned  why  some  relatively  nutritious  foods,  such  as 
broccoli  and  vitamins,  are  not  assigned  scores  in  the  Block  system,  while  other  foods,  such 
as  ketchup,  French  fries  and  donuts,  merit  positive  nutrient  scores. 

The  manual  scoring  systems  may  not  entirely  serve  the  purposes  of  the  clinic 
nutritionist  who  conducts  a  more  comprehensive  nutrition  education  effort  beyond  the 
level  of  determining  strictly  WIC  eligibility.  For  example,  it  was  felt  that  the  manual 
scores  do  not  help  evaluate  dietary  intake  of  nutrients  such  as  fats,  sodium  and  fiber,  and 
that  such  assessments  were  important  to  more  complete  counseling.  These  nutrients  are  in 
fact  captured  by  the  FFQs,  but  are  not  reflected  in  the  current  manual  scoring  systems. 
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SECTION  5  -  FUTURE  WORK 


The  present  study  has  identified  some  positive  results  regarding  the  usefulness  of 
FFQs  in  the  WIC  context.  However,  a  number  of  questions  and  possibilities  remain 

5.1  FURTHER  EXAMINATIONS  IN  THE  EXISTING  DATA  SET 

With  the  data  collected  for  this  study,  several  further  analyses  can  be  used  to 
improve  the  instruments.  Most  of  these  possible  further  analyses,  with  the  exception  of 
the  last  one  in  this  section,  could  be  conducted  at  fairly  little  additional  effort. 

Analyses  Aimed  at  Improving  the  FFQ 

In  the  Block  FFO 

Reformatting  Frequency  Categories  It  is  recommended  that  some  of  the 
frequency  response  categories  be  revised  before  any  further  use  of  this  FFQ.  Such  a 
revision  will  reduce  the  overestimation  of  vitamin  C  and  calcium  intake. 

Manual  Scores  Other  cutpoints  for  the  manual  scores  could  be  investigated.  The 
cutpoints  in  the  analyses  shown  in  Section  4.5  were  arbitrary,  based  on  estimates  derived 
from  published  CSFII  data.  Cutpoints  that  reflect  more  accurately  the  proportion  of 
women  with  intake  below  the  RDA  were  also  developed  based  on  the  existing  diet  recall 
data  (See  Appendix  E-1).  Additionally,  Tables  4-14  and  4-17  in  the  same  section  should 
be  redone  to  evaluate  whether  the  diet  recall  means  in  the  resulting  pass/fail  groups  are 
still  significantly  different. 

Food  Groups  As  noted  in  Section  4.7,  Food  Groups,  foods  to  be  included  in  the 
food  group  estimates  are  definable  by  the  user.  Thus,  one  could  specify  the  foods  which 
should  be  included  in  each  food  group,  based  on  dietary  recommendations  or  health 
education.  For  example,  one  could  elect  to  have  only  fruits  and  vegetables  in  the  group 
"Foods  rich  in  vitamin  A".  Table  4-21  in  Section  4.7  showing  average  servings  from  each 
food  group  could  then  be  repeated  using  groups  more  in  line  with  program  needs. 
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Improving  the  Calcium  Estimate.  The  Block  FFQ  overestimated  calcium.  This 
overestimate  may  in  part  be  the  resuh  of  the  two  milk  lines  on  the  Block  FFQ  (whole  and 
low-fat).  It  is  likely  that  some  women  were  confused  by  the  two  lines,  and  double- 
counted.  It  is  possible  to  rerun  the  Block  nutrient  estimates,  telling  the  program  to  ignore 
one  of  the  two  milks.  In  addition,  the  frequency  categories  for  milk  could  be  redefined. 
The  calcium  estimates  would  likely  be  lower  and  closer  to  the  diet  recall  estimates. 
Correlations  could  also  be  rerun  to  determine  whether  or  not  this  change  to  the  FFQ  might 
improve  the  calcium  estimates.  Other  explorations  of  sources  of  overestimations  could  be 
investigated,  such  as  those  described  below. 

Improving  the  Vitamin  A  Estimate.  The  Block  FFQ  overestimated  vitamin  A. 
This  may  be  the  result  of  including  too  many  vitamin  A  rich  foods  on  the  list.  The 
Nutrient  Sources  program  in  the  Block  software  can  be  run,  which  produces  a  ranked  list 
of  foods  in  order  of  their  contribution  of  vitamin  A  among  WIC  respondents  to  this  FFQ. 
The  nutrient  estimates  could  then  be  rerun,  omitting  the  least  important  foods.  It  would 
be  essential  to  recalculate  not  only  the  resulting  group  means,  but  also  the  correlation 
coefficients.  One  would  not  want  to  omit  a  food  from  the  FFQ  if  it  reduced  the 
correlations,  regardless  of  whether  or  not  it  reduced  the  overestimates. 

Improving  the  Protein  Estimate.  The  same  procedure  described  for  vitamin  A, 
above,  could  be  repeated  to  identify  a  better  food  list  for  protein  (if  improvement  was  still 
needed  after  correction  of  the  milk  estimate). 

Improving  the  Iron  Estimate.  Unlike  other  nutrients,  the  Block  FFQ 
underestimated  iron  intake.  This  appears  to  be  due  to  differences  in  the  nutrient  databases 
used  for  the  study.  The  NDS  database  assumes  higher  iron  content  for  baked  goods  than 
does  the  Block  database.  Revisions  should  be  investigated. 

Vitamin  Supplement  Correlations.  It  is  critical  to  examine  correlations  inclusive  of 
vitamin  supplements  as  well  as  exclusive  of  them.  With  supplements  excluded  it  is 
possible  to  evaluate  the  performance  of  the  FFQs  among  persons  who  do  not  take 
supplements,  and  is  consonant  with  FNS'  emphasis  on  foods.  However,  two-thirds  of  the 
WIC  population  did  take  supplements,  and  supplement  sources  comprise  a  significant 
component  of  their  nutrient  intake.  Thus,  to  fiiUy  evaluate  the  total  nutrient  intake  of  WIC 

WIG  Dietary  Assessment  Validation  Study 
Final  Report  -  September  22,  1994 
Page  5-2 


clients,  and  the  performance  of  FFQs  in  assessing  total  nutrient  intake,  correlations  in 
which  the  supplement  sources  were  included  should  also  be  examined. 

Edit  Criteria.  The  current  computerized  edit  criteria  for  identifying  questionable 
Block  FFQ  respondents  and  improving  the  nutrient  estimates  were  described  in  Section  3 . 
These  have  been  widely  used  and  proved  useful  in  other  analyses.  However,  some 
modifications  might  improve  the  nutrient  estimates  produced  by  the  FFQ.  In  particular, 
the  edit  program  permits  "unreasonably"  high  frequency  estimates  for  particular  foods  to 
remain,  if  there  is  only  one  such  estimate  in  an  FFQ.  The  remaining  one  food  could, 
however,  produce  erroneously  high  estimates  for  particular  nutrients.  The  edit  program 
can  be  modified  to  handle  these  situations.  In  addition,  the  merits  of  using  edit  criteria 
relating  to  unusually  high  or  low  energy  estimates  can  be  investigated.  The  Block 
software  automatically  calculates  a  variable  called  "Outlier,"  which  already  exists  on  the 
file.  Questiormaires  that  are  too  high  or  too  low  by  those  criteria  could  be  temporarily 
dropped  and  the  correlations  rerun,  to  examine  whether  those  flags  would  be  more  useful 
than  the  current  edit  criteria  in  identifying  questionable  respondents. 

In  Both  the  Harvard  and  Block  FFQ 

Both  FFQs  Substantially  Overestimate  Some  Nutrients.  This  may  be  in  part 
because  there  are  too  many  foods  on  the  food  list.  In  the  Block  software  the  least 
important  foods  can  be  identified.  If  nutrient  content  and  portion  size  assumptions  in  the 
Harvard  FFQ  were  made  available,  it  would  also  be  possible  to  run  the  Harvard  FFQ 
through  the  Block  software,  in  order  to  identify  the  ranked  Nutrient  Sources.  This  would 
make  it  possible  to  identify  which  foods  should  be  omitted  from  the  FFQs  in  order  to 
reduce  overestimation. 

In  addition  to  the  probability  of  having  too  many  foods  on  the  food  list,  another 
source  of  misestimates  is  related  to  the  fact  that  some  respondents  check  off  the  highest 
frequencies  of  consumption  permitted.  In  the  Harvard  FFQ,  each  food  on  the  FFQ  can  be 
reported  to  be  consumed  as  many  as  six  times  per  day.  One  exploratory  analysis  might 
examine  the  number  of  foods  checked  as  "5/day"  or  "6+/day",  separately  by  ethnic  group. 
The  Harvard  FFQ  overestimate  was  greater  among  Hispanics  than  among  the  other  ethnic 
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groups.  For  example,  among  African  Americans  the  diet  recall  mean  energy  was  2,211 
kcal  vs.  Harvard  FFQ  2,747;  but  among  Hispanics  the  diet  recall  mean  was  1,810  kcal  vs. 
the  Harvard  FFQ  mean  of  3,220.  It  is  likely  that  this  overestimate  was  caused  in  part  by 
numerous  responses  of  "6+/day,"  and  that  in  turn  these  substantial  overestimates  produced 
a  wider  range  which  was  the  source  of  the  higher  correlations  seen  for  Harvard  Hispanics 
(see  Section  4.4).  Block  FFQ  estimates  were  also  higher  for  Hispanics  than  for  the  other 
ethnic  groups,  although  not  significantly  so  in  any  case.  The  proportion  answering 
"2+/day,"  the  highest  Block  category,  could  also  be  examined. 

Analyses  Aimed  at  Investigating  Sources  of  Error  in  the  Diet  recall  Data 

As  noted  elsewhere,  it  is  likely  that  one  source  of  misestimates  in  the  diet  recall 
data  is  portion  size  estimation  using  the  two-dimensional  models.  It  would  be  of  interest, 
in  a  sample  of  respondents,  to  replace  the  respondent's  food  model  selection  with  a 
standard  portion.  Nutrient  estimates  from  the  diet  recalls  would  then  be  recalculated,  and 
the  correlations  with  FFQ  data  re-examined.  It  is  likely  that  the  resulting  correlations 
would  be  higher  than  those  presented  in  Section  4.4,  at  least  in  part  because  severe 
misestimates  in  the  reference  data  had  been  eliminated. 

5.2  SUGGESTIONS  FOR  FUTURE  RESEARCH 

Development  and  Testing  of  FFQs  for  Hispanics 

The  present  study  did  not  find  adequate  correlations  among  Hispanics  to  justify 
encouraging  self-administered  FFQ  use  among  WIC  Hispanics  at  the  present  time.  It 
should  be  emphasized  that  it  is  not  completely  clear  that  all  or  even  the  majority  of  the 
fault  lies  with  the  FFQs,  but  with  either  difficulties  in  self-administration  or  with  the 
reference  data.  Thus,  one  worthwhile  project  would  be  to  repeat  the  validation  study  in 
Hispanics,  but  administer  the  FFQ  by  interview.  It  is  possible  that  even  one  of  the  FFQs 
studied  here  would  have  proved  adequate,  if  administered  by  interviewer.  It  should  be 
remembered  that  one-third  of  the  Hispanic  women  in  this  study  had  six  years  of  education 
or  less,  and  many  were  probably  only  marginally  literate,  even  in  Spanish. 
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As  noted  elsewhere,  the  difficulty  of  collecting  good  reference  data  in  this  group 
may  have  been  an  important  source  of  poor  correlations.  Thus,  any  future  research  should 
emphasize  that  part  of  the  data  collection.  A  future  study  on  Hispanics  should  include  the 
following  components  in  obtaining  the  diet  recall  data: 

•  In-person  interviews  to  obtain  diet  recall  data; 

•  Bilingual  and  bicultural  interviewers; 

•  Possibly  not  three-dimensional  models  for  portion  size  in  the  recall  data,  but 
either  a  more  detailed  (weighed  duplicates  or  in-home  viewing  by  interviewer) 
or  less  detailed  (standard  portions  or  small-medium-large)  approach  to  portion 
size; 

•  Careful  collection  of  recipe  data  for  mixed  dishes,  and  careful  ascertainment  of 
the  portion  consumed  by  the  respondent;  and 

•  Data  collected  separately  in  the  three  major  Hispanic  ethnic  groups. 

If  administration  by  interview  still  results  in  poor  correlations,  a  more  extensive 
developmental  study  might  be  undertaken. 

Reconsideration  of  FFQ  Development  for  Hispanics 

Study  components  should  include: 

•  Food  list  development  based  on  results  of  ethnic-specific  diet  recall  data 
collected  as  above.  It  is  possible  that  both  the  foods  on  the  list  and  the  nutrient 
content  of  those  foods  might  differ  in  different  ethnic  groups; 

•  Mixed  dishes  on  food  list,  based  on  diet  recall  data  above.  It  is  possible  that 
the  nutrient  content  of  such  mixed  dishes  might  vary  in  different  ethnic  groups; 

•  Focus  groups  to  enhance  intelligibility  of  FFQ  form; 

•  It  is  possible  that  separate  translations,  or  possibly  even  separate  food  lists, 
should  be  developed  for  different  ethnic  subgroups  of  Hispanics.  Although  it  is 
likely  that  the  same  food  list  could  be  used,  it  may  be  that  different  translations 
would  be  desirable.  In  the  present  study,  all  ethnic-specific  wording  for  all 
three  ethnic  subgroups  was  printed  on  the  questionnaire.  That  is,  if  there  was  a 
different  term  for  a  food  among  Mexican  Americans  and  Puerto  Rican 
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Americans,  both  were  printed  on  the  questionnaire.  This  may  have  been  one 
more  linguistic  complexity  that  conflised  respondents  with  little  education;  and 
•    A  validation  study  should  compare  self-administered  with  interviewer- 
administered  questionnaires. 
Finally,  because  the  literacy  problem  may  limit  the  use  of  FFQs  in  Hispanics  in 
WIC,  no  matter  how  well-developed  the  FFQs,  FNS  might  consider  exploring  briefer 
instruments  for  this  population.     These  would  have  to  be  administered  by  WIC 
nutritionists  or  aides  and  would  not  be  intended  to  make  nutrient  estimates.  However, 
they  could  be  rigorously  developed  to  provide  useful  data  despite  being  substantially 
shorter  than  a  full  FFQ. 

Development  and  Testing  of  FFQs  for  Children 

The  present  study  did  not  find  correlations  that  would  justify  encouraging  FFQ  use 
to  ascertain  children's  diets  from  mothers  or  caregivers.  It  is  possible  that  the  poor 
correlations  may  be  an  effect  not  just  of  FFQ  limitations,  but  also  of  limitations  in  the 
reference  data.  Still  more  important  may  be  the  questionable  ability  of  any  caregiver  to 
report  accurately  on  the  diet  of  a  child  who  may  not  be  exclusively  in  that  person's  care. 
It  is  possible  that  no  method  can  be  relied  on,  whether  FFQ  or  24-hour  diet  recall.  Often, 
in  today's  society,  children  are  not  under  their  parents'  direct  observation  24  hours  a  day. 
Grandparents,  neighbors,  friends,  siblings,  baby-sitters  or  various  child  care  arrangements 
are  a  reality.  Even  if  it  were  possible,  in  a  research  study,  to  determine  what  the  child  had 
in  fact  eaten,  caregivers  may  always  be  limited  in  their  ability  to  report  it  accurately 
because  they  are  not  always  with  the  child.  It  is  possible  that  it  may  be  preferable  to 
relinquish  the  goal  of  obtaining  full  nutrient  data  regarding  small  children  by  any  method. 
Instead,  it  may  be  that  a  small  number  of  behavioral  questions  ("fhiit  every  day?",  "glasses 
of  milk?")  would  serve  WIC's  purposes  better. 
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SECTION  6  -  CONCLUSIONS 


6.1  HARVARD  VS.  BLOCK 

As  noted  in  Section  4.3  (Validity  Correlations),  the  ability  to  identify  where 
individuals  lie  along  the  distribution  from  low  to  high  intake  is  the  most  important  criterion 
measure  for  the  validity  of  a  food  frequency  questionnaire.  By  this  criterion,  the  Block 
FFQ  had  higher  correlations  than  the  Harvard  FFQ  for  almost  three-fourths  of  the 
comparisons  shown  in  Table  4-8.  Among  African  Americans  and  Whites,  9  of  12  Block 
correlations  were  at  or  above  0.40,  while  only  1  of  12  Harvard  correlations  was  that  high. 
By  the  second  administration  of  the  FFQs,  Block  still  had  higher  correlations  than  Harvard 
for  most  of  the  comparisons.  Thus,  in  terms  of  the  validity  of  the  instruments,  the  results 
in  Section  4.3  indicate  that  the  Block  FFQ  is  the  more  valid  instrument. 

Although  accurate  estimation  of  group  means  is  not  an  appropriate  criterion  for 
judging  FFQs,  it  is  an  added  benefit  when  it  occurs.  With  few  exceptions,  the  Block 
medians  and  means  were  closer  to  their  respective  recall  values  than  were  Harvard's,  and 
fewer  of  the  Block  means  were  significantly  different  from  the  recall  means. 

In  terms  of  error-proneness  of  the  estimates,  the  Harvard  FFQ  is  substantially 
more  error-prone.  For  example,  13%  of  all  Harvard  respondents  (20%  of  Harvard 
Hispanics)  were  excluded  because  of  energy  estimates  exceeding  4,500  kcal;  only  8 
(3  .4%)  of  the  Block  respondents  had  an  energy  estimate  that  high.  Estimates  of  vitamin  C 
in  excess  of  500  mg/day  were  seen  in  6.4%  of  Harvard  women  and  0.9%  of  Block 
women.  (For  comparison,  the  NHANES  II  95th  percentile  for  vitamin  C  was  290  mg.) 

The  Harvard  manual  score  and  instructions  declare  almost  all  respondents  to  be 
'feligible",  and  do  not  identify  correctly  those  who  are  not  in  fact  eligible.   The  Block 
manual  score  affords  more  flexibility,  and  distinguishes  those  with  low  and  high  intakes 
better  than  does  the  Harvard  score.  Further  improvements  in  the  Block  score  are  planned. 
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In  summary,  this  study  indicates  that  the  Block  FFQ  produces  more  valid  nutrient 
estimates  than  does  the  Harvard  FFQ,  and  the  Block  manual  score  is  both  more  valid  and 
more  flexible. 

6.2  UTILITY  TO  THE  WIC  PROGRAM 

Regardless  of  relative  merits  of  the  two  FFQs,  it  is  appropriate  to  ask  whether 
either  one  is  sufficiently  valid  to  be  useful  in  WIC,  and  for  what  groups. 

White  and  African  American  Women 

For  Whites  and  African-Americans,  the  correlation  data  suggest  that  the  Block 
FFQ  is  adequately  valid,  with  most  correlations  in  excess  of  0.40,  and  some  in  excess  of 
0.50.  After  correction  for  day-to-day  variability  in  the  recalls,  some  correlations  reached 
0.60  or  higher.  Although  the  correlations  were  lower  than  that  found  in  most  validations 
of  the  Block  instrument  (Block  et  al.,  1990a,  1990b,  1992;  Cummings  et  al.,  1987;  Sobell 
et  al.,  1989;  Mares-Perlman  et  al.,  1993),  they  indicate  a  fairly  useflil  level  of  validity. 
This  is  particularly  true  when  one  considers  the  nature  of  the  reference  data.  In  this 
population  there  appeared  to  be  considerable  error  in  the  reference  (recall)  data,  which 
would  itself  be  a  source  of  lowered  correlations. 

The  manual  scoring  system  for  women  also  appeared  adequately  able  to  identify 
groups  with  lower  and  higher  nutrient  status,  and  provides  the  flexibility  needed  by  WIC. 
For  those  who  prefer  a  single  pass/fail,  the  score  cutpoints  tested  here  performed 
adequately,  and  can  be  revised  to  improve  that  performance  still  further.  Also,  since  the 
system  has  demonstrated  its  validity,  it  would  be  possible  to  devise  similar  manual  scoring 
systems  for  other  nutrients. 

Hispanic  Women 

For  Hispanic  women,  neither  FFQ  can  be  recommended  to  assess  dietary  intake  in 
a  self-administered  format  at  the  present  time  (they  could  be  used  as  a  basis  for  providing 
nutrition  education).  Because  of  literacy  issues,  it  is  possible  that  no  self-administered  full 
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food  frequency  questionnaire  can  be  recommended  in  this  group  in  the  fairly  near  future. 
However,  it  is  possible  that  administration  by  interviewer  could  provide  useful 
information,  and  it  could  serve  as  a  focus  for  nutrition  education,  so  long  as  nutrients  or 
manual  scores  are  not  calculated  or  used  for  eligibility.  It  is  also  possible  that  reference 
data  collection  and  FFQ  design  can  be  improved,  and  Section  5  suggests  some  approaches 
to  that  end. 

Children  1-4 

For  caregivers  of  children  1-4,  neither  FFQ  can  be  recommended  to  assess  dietary 
intake  at  the  present  time.  Brief  simple  behavioral  questions  may  be  more  appropriate  for 
WIC's  purposes  for  this  age  group.  However,  the  FFQ  could  be  a  useful  tool  for  this 
group  as  a  focus  for  nutrition  education,  as  long  as  nutrient  or  manual  score  estimates  are 
not  calculated  or  used. 

Feasibility,  Acceptability 

Both  FFQs  were  completed  in  under  10  minutes  by  White  and  African- American 
respondents,  with  little  assistance.  Manual  scoring  was  accomplished  by  the  aide  in  three 
minutes.  The  three  WIC  agencies  consuhed  about  usability  of  the  FFQs  for  nutrition 
education  provided  the  following  conclusions  or  suggestions: 

•  The  portion  size  section  of  the  Block  FFQ  may  be  useful  in  nutrition  education 
about  portion  sizes;  and 

•  Both  instruments  could  be  useful  in  nutrition  education. 

Some  reviewers  felt  the  Block  manual  score's  focus  on  nutrients  did  not  mesh  well 
with  the  WIC  nutrition  education  focus  on  food  groups.  (It  should  be  noted,  however, 
that  the  Task  Force  on  Nutritional  Assessment  in  the  WIC  Program  explicitly 
recommended  a  system  keyed  to  the  RDAs.)  A  focus  on  food  groups  can  be  achieved  by 
providing  WIC  nutritionists  with  instructions  on  how  to  use  the  score  to  focus  their  own 
attention  on  possible  problem  nutrients,  and  then  to  conduct  nutrition  education  of  the 
client  by  pointing  to  specific  foods  or  food  groups  on  the  questionnaire  itself 
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Computer  scoring  of  the  FFQs  produces  estimates  of  more  than  30  nutrients  and 
percent  of  energy  from  macronutrients,  servings  from  the  pyramid  food  groups  (Block 
FFQ),  and  other  data.  Keying  of  either  FFQ  can  be  done  in  approximately  five  minutes 
In  the  fiiture,  some  WIC  clinics  may  have  scanners  available,  in  which  case  the  complete 
nutrient  estimates  can  be  produced,  without  keying,  in  just  a  few  minutes.  The  latter 
approach,  use  of  a  scanner  to  analyze  the  Block  FFQ  in  an  actual  WIC  clinic,  was  tested 
and  found  to  be  logistically  feasible,  by  Jacobson  et  al.  (1990)  in  evaluations  in  the  Florida 
WIC  program.  Thus,  full  dietary  evaluations  of  a  wide  range  of  nutritional  factors  are 
feasible  in  the  fiiture  for  WIC  agencies.  If  and  when  this  becomes  possible,  it  would 
permit  widespread  data  collection  in  the  WIC  system,  as  well  as  extensive  health  research 
on  maternal  and  child  outcomes  in  relation  to  nutritional  intake. 
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APPENDIX  A 


BLOCK  FOOD  FREQUENCY  QUESTIONNAIRE 


•  Cover  Page  for  Block  FFQ  (Women's  English  Version) 

•  Block  FFQ  for  Women  (English  Version) 

•  Block  FFQ  for  Women  (Spanish  Version) 
Block  FFQ  for  Children  (English  Version) 

•  Block  FFQ  for  Children  (Spanish  Version) 


The  Block  Food  Frequency  Questionnaires 
can  be  purchased  from: 

Dr.  Gladys  Block 
419  Warren  Hall 

University  of  California  at  Berkeley 
Berkeley,  California  94720 
(510)  643-7896 
Fax  (510)  643-6981 
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Cover  Page  for  Block  FFQ 


Women's  English  Version 


Foods  You  Ate  in  the  Past  4  Weeks 


Your  Name: 


This  form  will  take  about  15  minutes  to  complete. 


OMl  DtidaMrc  SUlcacnt 

Pubbc  reporting  bwden  tor  lha  cottecaoa  of  Ifilonnaoa  a  cwiwunl  id  nry  frtxn  10  -  25  mlnues  pa  reponse,  tnduding  (he  tune 
(or  revteviog  msroa¡ot&,  iardttfl(  aoaun  dia  Barco,  fubermn  lad  iinliiaiag  (he  diu  needed,  ind  cotupleUfig  ind  reviewuig  the 
collection  oí  Inlonnatioa  Send  lu— uiB  tepidiag  tm  hurirn  esomaie  or  iny  odicr  tspeO  ol  (his  coUedton  of  Intormiltofl,  Including 
Bigg<3tion5  k)r  reilDang  lha  biDte  10  DcpcrtmcM  o< /v^icalavr  Oearincc  Ollc^  Room,  404  W  Washington,  D  C  2025O,  ind  to  the 
OOice  of  MintgemoM  ind  BDd|a  fitiuBuit  latacsoa  trota  (0MB  NO  057S-OOIg).  VKShington.  D  C  20V)3 
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Block  FFQ  for  Women 


Instructions 


Foods  You  Ate  in  the  Past  4  Weeks 


•  This  form  asks  about  some  of  the  foods  you  ate  in  the  past  4  weeks. 
Remember  to  include  meals  and  snacks  eaten  at  home  or  ouL 


•  For  every  food,  please  mark  with  an  "X"  how  often  you  ate  that  fixxl. 
For  example,  if  you  drank  orange  Juice  twice  a  week  in  the  past  4  weeks, 
put  an  'X'  in  the  box  under  '2  per  week  '  (see  example  below). 


•  Please  tell  us  how  much  of  that  food  you  usually  eat  each  time. 
Put  an  "X"  under  "How  Much  Each  Time?"  for  smalL  mediimi.  or  la£ge. 
Is  the  amount  small,  medium  or  large  compared  to  other  women  vour  aee? 
Look  at  tbe  example  below  for  a  large  glass  of  orange  juice. 


•  For  some  foods  the  "How  MixJi"  will  be  very  specific. 
For  example,  if  you  ate  bread  twice  a  day  and  usually  bad  about  one 
slice  each  time,  you  would  put  an  'X'over  tbe  'I'for  1  slice  (see  example). 


Example: 


How  Often  in  the  Psist  4  Weeks? 


How  Much 
Each  Time? 


Foods  You  Ate  in 
the  Past  4  Weeks 


Orange  juice 


Brad,  including  sandwiches, 
bagels  and  burger  roll* 


PER  WEEK 

PER  DAY 

Í 

1 

•oa* 

J  i 
tail 
•oadi 

I  tme 

2 

wok 

H 

U> 
week 

I 

d>y 

2* 
pef 

dfV 

K 

AMOUNT 

E 

=3 

3, 

2 

3* 
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How  Often  in  the  Past  4  Weeks? 

How  Much 
Each  Time? 

t 

z 

PERMOtmi 

PER  WEEK 

PER  DAY 

AMOU^^■ 

Foods  You  Ate  in 
the  Past  4  Weeks 

I  ttnie 
list 
■oolh 

2-J 
hsl 
ooad) 

1  Mme 
veck 

2 

V* 
veck 

M 
veck 

P« 
week 

1 

Pff 
day 

2+ 
P« 

e 

a 

f 

z 

1 

1 

2 
3 
4 

Bananas 

Oranges 

Peaches,  cantaloupe 

Apples,  grapes  or 
any  other  fruit 

z 

1 

PERMOtmi 

PER  WEEK 

PER  DAY 

AMOUNT 

1  ime 

BOOdl 

2-J 
bst 

OHMldl 

1  ttme 
week 

2 

P« 
veck 

P" 
vede 

« 
P» 
veck 

I 

V* 

2* 
P« 

E 
s 

f 

b 

5 
6 

7 

e 

B 

10 
11 

12 
13 
14 

15 

Tomatoes 

Broccoli 

Greens,  spinach 

il 1 1^ Í 4 

Cole  slaw,  cabbage 

Carrots 

Green  salad 

Salad  dressing 

n    ,  1 

Potatoes  including 
French  fries 

Sweet  potatoes,  yams 

Cooked  green  peppers, 
chile  rellenos 

Any  other  vegetable 

e             0             •              t              )             I             2             3  4 

-- '    >';^?-  ^' 

1  Í  Í  1 1/;:, 
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How  Often  in  the  Past  4  Weeks? 


How  Much 
Each  Time? 


Foods  You  Ate  in 
the  Past  4  Weeks 


16 


Cooked  cereals,  gnu 


Milk  on  cereal 


Bacon,  sausage,  links 


Spaghetti  with  tomato 
sauce 


Hamburgers,  chccscbuigcrs, 
beef  burritos,  tacos  


Beef  (steak  or  roast),  ribs 


Mixed  disbcs  with  bcci 
like  beef  stew 


Liver  including 
chicken  Uver 


Pork,  pork  chops,  roasts 


Fned  chicken 


Other  chicken  (strwcd, 
baked  or  roasted) 


Tuxu  sandwich  or 
tuna  casserole 


Fish,  Gsh  sandwich 


1 

2 

1 
\ 

PERMOfnH 

PER  WEEK 

PER  DAY 

I  ttine 
bsi 
■oath 

2-J 
bsl 

1  mmt 
wttk 
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P« 
week 

M 
P» 
week 

•eek 
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2* 
P« 
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PER  MONTH 
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PER  DAY 

I  Me 
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2  J 
bsl 

■KMlh 

1  «me 
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2 

week 

H 
P» 
week 

5-6 
P» 
week 
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P« 

2+ 
f 

AMOUNT 

Medium 
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1  1  2  |3* 

Pieces 

1  1  2  |3+ 

AMOUNT 

Modldin 
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How  Often  in  the  Past  4  Weeks? 


Foods  You  Ate  in 
the  Past  4  Weeks 


39 


40 


42 


Beans  like  pinto  or 
rcfricd  beans 


Rice 


Chili  with  meat  or  beans 
(American  style) 


Vegetable  soup, 
tomato  soup 


Any  other  soup 


Pizza 


Lundi  meats,  sliced  ham 


Hot  dogs 


Biscuits,  mufTins 


Com  bread,  com  muflins 


Margarine  or  buacr 


Cheese  and  cheese  spread 


Mixed  dishes  with  cheese, 
macaroni  and  cheese 


Salsa,  taco  sauce,  ketchup, 
hot  red  peppers  


Bread,  including  sandwiches. 
bagels  and  burger  rolls 


Com  tortillas 


Flour  tortillas 


Z 

PERMo^mi 

PER  WEEK 

PER  DAY 

1  tine 
tasi 
■ontti 

23 
moadi 

week 

2 

P« 
week 

week 

P» 
week 
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V* 
dm/ 

2* 

P« 
diy 
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PERMOVm 

PER  WEES 

PER  DAY 

I  Ose 
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2  5 
\M 
Boalh 

1  tmt 

P« 

2 

M 
P" 
«eck 

P<» 
week 
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P» 
diy 

2+ 
pw 

How  Much 
Each  Tunc? 


AMOUNT 

Medium 

1 

Sboa 

I  1  2  13* 

Sbces 
1  1  2  |3+ 

HMDogt 
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AMOUVr 
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E 
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Urge 
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Foods  You  Ate  in 
the  Past  4  Weeks 


Chip»,  popcorn,  crackers, 
pork  skins  


Ice  cream  or  pudding 


55    Orange  jiucc 

56 


60 


62 


Donuts,  pastry 


54    QiocoUie  candy,  candy  bars 


Apple  juice,  grape  jujce 


Kool-Aid,  fruit  dnnks.  HKI 


Lowfai  and  skim  milk  (not 
including  milk  on  cereal) 


Regiiiar  milk  (not 
including  milk  on  cereal) 


Milk  or  cream  In  cofTee 
or  tea 


Regular  soft  dnnks 
(not  diet  soda) 


Beer  (all  types) 


All  types  of  wine, 
wine  coolers 


Liquor  (all  types) 


Sugar  in  coffee,  tea  or  on  | 
cereal  (noc  sugar  substitutes  li 


How  Often  in  the  Past  4  Weeks? 


How  Much 
Each  Tunc? 
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? 
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PER  WEEK 

PER  DAY 
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faB( 
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During  the  past  4  weeks,  how 
many  pills  cüd  you  usually  take? 


Multiple  Vitamins 


Prenatal  vitamins 


Multiple  vitamins  Mke 
Onca-Day  tablets 


Single  Vitamins 


68 


70 


Iron  pills 


Caldum  pills 


Vitamin  E  pills 


Vitamin  C  pills 


None 

PER  WEEK 

PER  DAY 

1-3 

pw 
week 

Á-6 

P« 
week 

1 

P» 

2 

PW 

3 

P« 
diy 

4 

P« 
diy 

5+ 

P« 
d«y 

None 

PER  WEEK 

reRDAY 

1-3 
Pff 
week 

1 

per 

2 

P« 
diy 

3 

P« 
dfy 

4 

P» 
diy 

5+ 

P« 
diy 

72 


If  you  take  Vitamin  C,  how  many  milligrams 
of  Vitamin  C  is  in  each  tablet? 


100 

2S0 

500 

1000 

Don't 
Know 

Thank  you  for  completing  this  form! 


^'  -  '^'.y<  /i'-'V'  '"-W-.  s'^'ís'í. 
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Instructions 


Alimentos  Que  Usted  Comió  en  las  Ultimas  4  Semanas 

•  Este  cuestionano  le  pregunta  sobre  algunos  de  los  alimentos  que  usted  comió  en 
las  últimas  4  semanas.  Acuérdese  de  incluir  comidas  y  meriendas/entre  comidas 
dentro  y  afuera  de  su  casa. 


•  Para  cada  alimento,  por  £avor  marque  con  una  "X"  debajo  de  la  casilla  que  indica 
que  tan  seguido  usted  comió  ese  alimento.  Por  ejemplo,  si  usted  bebió  jugo  de 
naranja  dos  treces  por  semana  en  las  últimas  4  semanas,  marque  con  una  'X' 
en  la  casilla  bajo  '2  por  semana' (vea  el  ejemplo  que  sigue). 


•  Por  Eavor  déjenos  saber  la  cantidad  de  esc  alimento  que  se  come  cada  vez.  ¿Es  la 
cantidad  pequeña,  mediana  o  grande  comparada  con  otras  mujeres  de  su  edad? 
Marque  con  una  "X"  bajo  "¿Cuánto  Cada  Vez?",  escogiendo  entre  Chico.  Mt^ía^p 
y  Grande.  Fíjese  en  el  ejemplo  que  sigue  para  un  vaso  de  jugo  de  naranja 
grande. 

•  Para  algunos  alimentos,  "¿Cuánto  Cada  Vez?"  será  muy  específico.  For  ejemplo, 
si  usted  comió  pan  dos  veces  al  día  y  usuabnente  se  comió  una  rebanada 
cada  vez,  usted  marca  con  una  'X' sobre  el '1 'por  una  rebanada  (vea  el 
ejemplo  que  sigue). 


Ejemplo: 


¿  Qué  Tan  Seguido  en 
las  Ultimas  4  Semanas? 


<Cuinco 
Cada  Vez? 


Comidas  Que  Comió  en 
las  Ultimas  4  Scn:;aiias 


Jugo  de  aannia/china 


Pan  tnduYcndo  sandwiches, 
bagcb  y  pan  de  hamburguesa 


FORMES 

POR  SEMANA 

POR  DIA 

9 
i 

3 

ad 

J5 
t>d 
•a 

1  «3 

r* 

H 

V6 
?<* 

1 

2« 
dú 

•enumw 

min* 
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T 
z 
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fümtoaú 

tía! 

3L 

2 

3- 
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¿Qué Tan  Seguido  en 
las  Ultimas  4  Semanas? 


(Cuánto 
Cada  Vc2? 


Comidas  Que  Comió  en 
las  Ultimas  4  Semanas 


Pliianos/guincos/bananos 


Nani^/chínas 


Mctocotoncs/duraznos  o 
melón  cantal  upo 


Manzanas,  uras  u  otra  fruta 


Tomates 


Broccoli/brccot 


Espinaca 


Ensalada  de  col,  repollo 


Zanahorias 


Ensalada  de  lechuga 


Aderezo  para  ensalada,  o 
mayonesa,  aliño 


Papas  incluyendo  papas  fritas 


Bataus,  ñames,  camotes 


Chile  rellenos 


Cualquier  otra  verdura/vegetal 


2 

o 
z 

9 

FORMES 

POR  SEMANA 

FORDU 

1  <a 
(B  d 
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25 
ta  d 
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lia 
pof 
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2* 
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■o 
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M 
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O 
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Cm  de 

CUANTO 

O 
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Gnnde 

P««c  1 
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¿Qué Tan  Seguido  en 
las  Ultimas  4  Semanas? 


¿Cuánto 
Cada  Vez? 


Comidas  Que  Comió  en 
las  Ultimas  4  Semanas 


Cereal  cocido 


Cereales  fríos,  como  Chccnos, 
con  o  sin  leche 


Leche  en  cereal 


Huevos/blanquiUoe 


Todneta/iocino.  salchichas 


Espaghcü  con  salsa 
de  tomate 


Hamburguesas,  hamburguesas 
con  queso,  burrItDa  de  res,  tacos 


Bistec  o  rosbií/camc  de  res, 
costillas 


Caldo  de  res 


Hígado  incluyendo  hígado 
de  poUo 


Cerdo  incluyendo  chuletas, 
asados,  puerco/marrano 


Pollo  frito 


Otro  pollo  (pollo  en  caldo, 
horneado  o  asado) 


Sandwich  de  atún  o 
'tuna  casserole* 


Pescado  o  sandwich  de 
p>e3cado 


8 
1 

3 

FORMES 

POR  SEMANA 

POR  DIA 

1  ia 
a  d 
ma 
pmtáo 

3-5 
CB  d 
Bes 
pmtáo 

1 1d 

2 

P« 

w 

pof 

P» 

1 

P» 
dá 

1* 

por 
dii 

£ 

3 

FORMES 

POR  SEMANA 

POR  DIA 

1  Wl 

a  d 
mo 
paudD 

3  5 
ta  d 
mtt 
pmMáio 

1  <C2 

2 

PW 

M 
P» 

1 

POf 

2* 
por 

CUANTO 

CWco 

O 

6 

1 

■« 
1 

1  1  2  15* 

¿Cuinlo' 

1  1  2  1 3+ 

cuAvrc 

e 
f 

* 
1 

P««c2 


iii  |ií' 

liblii 
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¿ 

Qué  Tan  Seguido  en 
las  Ultimas  4  Semanas? 

¿Cuánto 
Cada  Vez? 

21 

FORMES 

FOR  SEMANA 

PORDU 

ojAvrc 

;-.x«»>;<>>>;-íí'N*>:í>:o: : ; 

Comidas  Que  Comió  en 
las  Ultimas  4  Semanas 

1  «a 
cu  d 
Bes 

3-5 
en  d 
ma 
pmaáa 

1  ia 

2 

fx* 

M 
P« 

1 

P" 
dá 

2* 

P" 
di* 

i 

■8 
z 

-8 
1 

31 
32 
33 

34 

35 
36 
37 
36 

Fríjoles  como  fríjol  pinto  o 
refritos  o  h2i>ictiuci25 

Amz 

^^^^^^  ~l  j  11 1  ij           ^^^^  ^^^^^^^ 

'Chili  con  carne"  estilo 
americano 

Sopa  o  caldo  de  verduras/ 
vegetales  o  tomates  sin  res 
o  poDo 

Otras  sopas  o  caldos 

Pina 

Rebanadis 

1  1  2  |3+ 

Jamón,  fiambres,  carnes  frías, 
carne  de  lonche 

Rebanadas 

1  1  2  |3+ 

Hot  dog/pcrro  caliente 

1 

HotOogs 

1  2  !3* 

i<g$:>"^=^?^;;  ^"^"^ 

•:-^:^•^^:s^^N^  5N:>:-^  ^^^ín  :>>í-;v;  :':snN';s':'XS«- 
X<  >sN<^=^        SS:.^  ""^"í^SÍ^&sSl 

>;-:>,s^         í-^n-íí-  ^í-^"-»  v;ssS;>>:--''yx 

FORMES 

FOR  SEMANA 

FOR  DIA 

CUANTO 

1  m 
aé 
na 
pmaáo 

J  5 
cad 
ma 

1  «a 

2 

P" 

H 

I 

7* 
por 
dit 

o 

-8 
J 

39 
40 
41 
42 
43 
44 
45 
46 
47 

Pancdik»,  bizcochos/ 
bisquctcs 

Pan  de  maíz,  ptanccillos 
de  maíz 

Margarina  o  mantcquilb 

Queso  y  queso  crema 

■■"      Í^h^-mIfít,  k,,  1     ". Lí,,^^;:!^;: 

Platillos  con  queso  incluyendo 
macarrón  con  queso 

■  .;  :■:■:■:<■:■: 
sV 

Salsa,  ketchup,  chiles  rojos 
picantes 

Pan  incluyendo  sandwiches, 
bagcis  y  pan  de  hamburguesa 

1 

Cada  «ez 

1  2  Í3+ 

'     i  1  I:., 

Tórtolas  de  maiz/masa 

ToriUai  (caM 

1  1  2  |3-»' 

1  1  N 

 i 

Tortillas  de  hanru 

i 

lonliu  (cMisi) 

1     2  13-t- 

•  uu- 

•            •            t            t             <            2            2            1  4 
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Page  4 


¿Qué Tan  Seguido  en 
las  Ultímas  4  Semanas? 


Comidas  Que  Comió  en 
las  Ultimas  4  Semanas 


BocaditM  salados  como 
papilas  fritas,  palomitas  de 
maiz,  chicharrón  de  puerco 


Maníei/ocahuilet,  mamcquifia 
de  maní/crema  de  r-xr^ynm^ 


Helado/ni  evc/raantecado, 
budín/pudín 


Yogiiit  o  yogim  congelado 


Donas,  pan  dulce 


Pastel,  tortas,  gafietas 


Dulce  de  chocolate 


62 


Jugo  de  naranja/china 


Jugo  de  manzana  o  de  uva 


Kool-Aid  o  bebidas  de  fruta, 
aguas  frescas 


Leche  descremada/"  lowfai* 
(sin  incluir  leche  en  cereal) 


Leche  en  lera/*  whole" 
(sin  incluir  leche  en  cereal) 


Leche  o  crema  con  café  o  t¿ 


Sodas  (sin  incluir  sodas 
de  dieta) 


Cerveza 


Todo  upo  de  vuio,  'winc 
coolers' 


Licor,  todo  tipo  de  licor 


Azúcar  en  ca/c.  te  o  con  ccrcaj 
(sin  incluir  azúcar  de  dicta) 


(Cuánto 
Cada  Vez? 


s 

Ti 

s 

POR  MES 

POR  SEMANA 

POR  DIA 

lia 
ca  d 
■es 

2-5 
ca  d 
■a 

2 

P«r 

P» 

Vé 
P" 

1 

P" 
dti 

2-» 
P» 
dá 

0             0             0              1              1             I             2             I  4 

¿ 
1 

M 
aé 

■<3 

POR  SEMANA 

PORDU 

1  «a 
P» 

ía 

P» 

Vé 
P" 

1 

P» 
dii 

2 

POf 

H 
P» 
di* 

Vé 

aiAKTO 

CMc» 

i 

1 

•8 

1 

OJAfíTO 

Chko 

o 
S 

1 

■8 
J 

Pige-4 
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¿Durante  las  últimas  4  semanas,  cuántas 
pildoras  se  tomó  usualmcnte? 


Vitaminas  Múltiples 


vitaminas  prenatales 


Vitaminas  múltiptc*  como 
VUamma  Una  aJ  Día 


Vitaminas  Individuales 


68  PíklorasAabIctas  de  hierro 


70 


PUdoras/tabletas  de  calcio 


Vitamina  E 


Vitamina  C 


l 

POR  SEMANA 

POR  DIA 

15 
P" 

P" 

P» 
díi 

2 

P» 
díi 

5 

P» 
díi 

i 

P» 
dá 

P» 

dá 

i 

i 

POR  SEMANA 

POR  DIA 

1  5 

P« 

1 

por 
dá 

2 

P<* 
dá 

5 

P" 
éA 

4 

P» 

dá 

5* 

P" 
dá 

72 


¿Si  usted  toma  Vitamina  C,  cuántos  miJifjramos 
de  Vitamina  C  uenc  cala  pildora? 


100 

250 

500 

1000 

^4o 

Sé 

¡Gracias  por  completar  este  cuestionarlo! 


P««c  1 
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Instructions 


Foods  Your  Child  Ate  in  the  Past  4  Weeks 

•  This  form  asks  about  some  of  the  foods  your  child  ate  in  the  past  4  weeks. 
Remember  to  include  foods  eaten  at  day  care  or  with  relatives  or  friends. 

•  For  every  food,  please  mark  with  an  'X"  how  often  your  child  ate  that  food. 

For  example,  if  your  child  drank  orange  juice  twice  a  tueek  in  the  past  4  weeks, 
put  an  'X'in  the  box  under  '2 per  week' (see  example  below). 

•  Please  tell  us  how  much  of  that  food  your  child  usually  cats  each  time.  Is  the 
amount  small,  medium  or  large  compared  to  other  children  of  the  same  aec? 
Put  an  'X"  under 'How  Much  Each  Time?"  for  smalL  medium,  or  large. 

Look  at  the  example  below  for  a  large  glass  of  orange  Juice. 

•  For  some  foods  the  "How  Much"  will  be  very  specific. 

For  example,  if  your  child  ate  bread  twice  a  day  and  usually  bad  about  one 
slice  each  time,  you  would  put  an  'X'over  the  'I'for  1  slice  (see  example). 


Example: 


How  Often  in  the  Past  4  Weeks' 


How  Much 
Eac±i  Time' 


Foods  Your  Child  Aic 
in  the  Past  4  Weeks 


Orange  |ujcc 


Bread,  including  smwi cha, 
bagels  and  buiyr  roUi 


rtB  MONTH 

PER  WEEK 

PER  DAY 

{ 

3  5 

2 

5-4 

S-6 

1 

2* 

J 

tail 

•CM* 

moméi 

wttk 

veek 

div 

P" 
diy 

AMOWr 

E 

% 

z 

Í 

2 

3- 
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Child's  Name: 

t>o  Not  Write 

t 

PERM 

*n  in 

i^ll  Hi 

OVTH 

f  hi* 

LI  1^ 

PER^ 

4  Wp 

«  TVt 

PER 

DAY 

Coi 
Oth< 

Ho 
Enc 

AJ 

npan 

tCW 

(VM 
hTi 

VlOU 

■d  to 
J  dren 

uch 
me? 

vr 

1 

2 
3 
4 
5 

Foods  Your  Child  Ate 
in  the  Past  4  Weeks 

Bananas 

z 
£ 

1  time 
list 
monlh 

2-3 
lisl 
monlh 

1  bme 
per 

2 

per 

H 
per 

S-6 
per 

1 

per 
diy 

2+ 
day 

=3 

Medium 

f 

Oranges 

iBl;;:  ':'^^-  ■•^^^ 

Peaches,  cantaloup>e 

Baby  food  fruit 

Apples,  grapes  or 
any  other  fruit 

PER  MONTH 

PER  WEEK 

PER  DAY 

AMOUNT 

Altnosl  Neve 

1  bme 
Usi 
monlh 

2-3 
lisl 
monlh 

1  bme 

Pff 
week 

2 

pef 
week 

p» 

week 

1 

P« 
diy 

2■^ 

P« 
diy 

=3 

Medium 

6 
7 

e 

9 

10 

11 

12 
13 
14 
15 
16 

Tomatoes 

Broccoli 

Greens,  spinach 

lOGimii 

Cole  slaw,  cabbage 

Carrots 

i  □  ; 

i:    «i:-:  o 

Green  salad 

Salad  dressing 

Potatoes  including 
French  fries 

Sweet  potatoes,  yams 

l;:AD:lliÍIIÍ 

Cooked  green  peppers, 

Any  other  vegetable 

0             0             0             1              1              2             2             3  4 
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Child's  Name: 

Hov 

/  Often  in 

the  Past  4  Weeks? 

Compared  lo 
Other  QiiJdren 

How  Much 
Each  Time? 

JOo  Not  Write 
Below 

17 
18 
19 
20 
21 
22 

Foods  Your  Child  Ate 
in  the  Past  4  Weeks 

Cooked  cereals,  grits, 
hot  baby  food  cereals 

AJmost  Never 

PERM 
I  time 
month 

OVTH 
2  3 

lad 

month 

1  time 
week 

PER\ 
2 

PER 
1 

diy 

DAY 
2+ 
diy 

AJ 
J 

Medium  O 

NT 
& 

is    -                     ^  i 

o  ; 

Gold  Gcreals,  sudi  as  Cheenos, 
with  or  without  milk 

m  □  : 

Milk  on  cereal 

Sugar  on  cereal 

Teaspoons 
1  1  2  l3+ 

Eggs 

Eggs 
1  1  2  |3+ 

-  ^"i    1    II  si 

Bacon,  sausage,  links 

Pieces 
1  |2|3. 

Almosi  Never 

PER  MONTH 

PER  WEEK 

PER  DAY 

AMOuyr 

1  time 
list 
month 

2-3 
list 
month 

1  time 

P« 
week 

2 

P« 
week 

3-4 

1 

diy 

2+ 

P« 
diy 

=a 

Medium 

& 

23 
24 
25 
26 
27 
28 
29 
30 
31 
32 

Spaghetti  with  tomato 
sauce 

ÍliÜ™CIII 

Hamburgers,  cheesebuigcrs, 
beef  burritos,  tacos 

Beef  (steak  or  roast),  ribs 

L,  ¿iiODIII 

Mixed  dishes  with  beef 
like  beef  stew 

Liver  including 
chicken  liver 

ii::U:.::  : 

Pork,  pork  chops,  roasts 

Fried  chicken 

Other  chicken  (stewed, 
baked  or  roasted) 

.□ill 

Tuna  sandwich  or 
tuna  casserole 

Fish,  fish  sandwich 

□ 

0             0             0             1              1             2             2             3  4 
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Child's  Name: 

Hov 

/  Often  in 

the  Past  4  Weeks? 

ConpsTCd  to 
Other  Children 

How  Much 
Each  Time? 

l>o  Not  Write 

33 
34 
35 
36 
37 
36 
39 
40 

Foods  Your  Child  Ate 
in  the  Past  4  Weeks 

Beans  like  pinto  or 
refried  beans 

Almost  Neva 

PERM 

1  üme 
list 
mofilh 

ONTH 

2-3 
last 
month 

1  time 

P" 
week 

PER\ 
2 

Pff 
week 

VEEX. 
H 

5-6 

PER 
1 

P» 
day 

DAY 

2+ 

P« 
day 

AI 

=a 

Medium  o 

Urge  ^ 

^  i 

-  mn 

Rice 

Chili  with  meat  or  beans 
(American  style) 

i 

V^etablc  soup, 
tcHnato  soup 

□  ; 

Any  other  soup 

Pizza 

Slices 
Il2|3. 

Lunch  meats,  sliced  ham 

Slices 
1  1  2  1 3+ 

□□ 

Hot  dogs 

Hot  Dogs 
1  1  2  1 3+ 

Almost  Never 

PERMO^frH 

PER  WEEK 

PER  DAY 

AMOUNT 

1  lime 
last 
month 

2  3 
last 
month 

1  time 

P» 
week 

2 

P" 
week 

U 

5-6 

pw 

week 

1 

per 
day 

2+ 

P" 
day 

=3 

Medium 

Large 

liillBBi 

41 
42 
43 
44 
45 
46 
47 
46 
49 

Biscuits,  muffíns 

Com  bread,  com  muffíns 

Margarine  or  butter 

Cheese  and  cheese  spread 

Mixed  dishes  with  cheese, 
macaroni  and  cheese 

iii-:  UU    Li  i 

Salsa,  taco  sauce,  ketchup, 
hot  red  peppers 

Bread,  including  sandwiches, 
bagels  and  burger  rolls 

Slices  (xk  anc) 

1  ¡2l3. 

□□□ 

Com  tortillas 

ToclilUEtcKlitod 

1  1  2  |3+ 

□□ 

Flour  tortillas 

Tanillis(aikiBc) 

1  1  2  |3+ 
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Child's  Name: 

How 

PERM 

in  in 

ONTH 

the 

Past 

PER 

4  We 

VEEK 

eks? 

PER 

DAY 

Coo 
Othc 

Hot 
Eacl 

Af 

iv  M 
hTi 

40U 

dto 
dren 

uch 
me? 

MT 

Ji/Q  raJc  Mr  mC 

50 
51 
52 
53 
54 
55 
56 

Foods  Your  Child  Ate 
in  the  Past  4  Weeks 

Chips,  popcorn,  crackers, 
p>ork  skins 

z 

? 

e 

last 
month 

7  \ 

last 
month 

2 

Pet^ 

7^ 
P^ 

1 

Pff 
day 

2+ 

P« 
day 

1  Medium 

& 

Peanuts,  peanut  butter 

Ice  cream  or  pudding 

lKj)i\U\,f  lAKjUdi  juy^tm. 

(including  lowfat) 
Donuts,  pastry 

□ 

Cake,  cookies 

Chocolate  candy,  candy  bars 

0 

0 

0 

1 

1 

2 

2 

3 

4 

Almost  Never 

1-3 
times 

last 
month 

PE 
1  time 

J?  WEE 
2-i 

K 

5-6 
P^ 

1 

day 

PER 
2 

per 
day 

DAY 

3-4 

P» 
day 

5-6 

P« 

day 

At 

Medium  O 

^^■ 

m 

57 
58 
59 
60 
61 
62 

Orange  juice 

Apple  juice,  grape  juice 

Kool-Aid,  fruit  drinks,  Hi-C 

Lowfat  and  skim  milk  (not 
including  milk  on  cereal) 

m  □: 

Regular  milk  (not 
including  milk  on  cereal) 

Regular  soft  drinks 
(not  diet  soda) 

000123466 
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Child's  Name: 


During  the  past  4  weeks,  how  many 
pills  did  your  child  usually  take? 


Multiple  Vitamins 

Pills,  chewable  tablets  or  liquid 

None 

PER  WEEK 

PER  DAY 

13 

4-6 

1 

Pff 
d<y 

2 

P« 
(by 

3 

P« 
diy 

4 

P» 
dsy 

5+ 

pef 
diy 

Multiple  viumins  like  One-a-Day 
tablets,  children's  vitamins 

Single  Vitamins 

Pills,  chewabic  tablets  or  liquid 


68 


Iron  pills 


Calcium  pills 


Vitamin  E  pills 


Vitamin  C  pills 


None 

PER  WEEK 

PER  DAY 

1-3 

1 

P" 
diy 

2 

P« 
diy 

3 

per 
diy 

4 

P« 
diy 

5+ 

per 
diy 

If  your  child  takes  Vitamin  C,  how  many 
milligrams  of  Vitamin  C  is  in  each  tablet? 


100 

250 

500 

1000 

Don'l 
Know 

Thank  you  for  completing  this  form! 
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Instructions 


Alimentos  Que  Su  Niño/a  Comió  en  las  Ultimas  4  Semanas 

•  Este  cuestionario  le  pregunta  sobre  algunos  de  los  alimentos  que  su  niíio/a  se 
comió  en  las  últimas  4  semanas.  Acuérdese  de  incluir  los  alimentos  que  se  hayan 
comido  en  la  guardería  infantil  o  con  familiares  o  amistades. 


•  Para  cada  alimento,  por  favor  marque  con  una  "X"  debajo  de  la  casilla  que  indica 
que  tan  seguido  su  niño/a  comió  ese  alimento.  Por  ejemplo,  si  su  niño/a  bebió 
Jugo  de  naranja  dos  veces  a  la  semana  en  las  últimas  4  semanas,  marque  con 
una  'X'en  la  casilla  debajo  de  '2 por  semana' (vea  el  ejemplo  que  sigue). 


•  Por  favor  déjenos  saber  la  cantidad  de  ese  alimento  que  su  nüío/a  se  come  cada 
vez.  ¿Es  la  cantidad  pequeña,  mediana  o  grande  comparada  con  otros  niños  de  la 
misma  edad?  Marque  con  una  "X"  bajo  "¿Cuánto  Cada  Vez?",  escogiendo  entre 
QliCQ,  Mediano  y  Grande.  Fíjese  en  el  ejemplo  que  sigue  para  un  vaso  de  jugo 
de  naranja  grande. 

•  Para  algunos  alimentos,  "¿Cuánto  Cada  Vez?"  será  muy  específico.  Por  ejemplo, 
si  su  niño/a  comió  pan  dos  veces  al  día  y  usuabnente  se  comió  una  rebanada 
cada  vez,  usted  marca  con  una  'X' sobre  el' 1 'por  una  rebanada  (vea  el 
ejemplo  que  sigue). 


Ejemplo: 


¿Qué  Tan  Seguido  en 
las  Ultimas  4  Semanas? 


Conpmálo  ■ 
otros  nlAos 

¿Cuánto 
Cada  Vez? 


Comidas  Que  Su 
Niño/a  Comió  en  las 
Ultimas  4  Semanas 


Jugo  de  nann)a/chtru 


Pan  incluyendo  sandwiches, 
bagcis  y  pian  de  hamburguesa 


FORMES 

POR  SEMANA 

POR  DIA 

■  •a 
cad 
na 

25 
es  d 
■o 
psado 

1  «cz 

2 

por 

iOIllIU 

5-4 
por 
scmini 

5-6 
por 
lemuu 

I 

por 
dú 

2* 
por 
dú 

X 

OJANTO 

o 

i 

-8 

S 

5 

•a 
z 

1 

¡QiiniDai 

lio? 

2 

5* 

ScaJe  75%  of  onginal 
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Block  FFQ  for  Children  (Spanish  Version) 


Page  1 


Nombre  del  Niño/a: 


Comidas  Que  Su 
Niño/a  Comió  en  las 
Ultímas  4  Semanas 


PUtanos/guincos/bananos 


Nuan|as/chinas 


Melocotones/duraznos  o 
melón  canulupo 


Comida  de  niüo  fruta 


Manzanas,  uvas  u  otra  fruta 


10 


Tomates 


Brocooli/brccol 


Espinaca 


Ensalada  de  col,  repollo 


Zanahorias 


Ensalada  de  lechuga 


Aderezo  para  ensalada,  o 
mayonesa,  aliño 


Papas  Incluyendo  papas  fritas 


Batatas,  ñames,  camotes 


Chile  rellenos 


¿Qué  Tan  Seguido  en 
las  Ultimas  4  Semanas? 


Comparado  a 
otraa  niAos 

¿Cuánto 
Cada  Vez? 


Cualquier  otra  verduraA'egetal 


3 

3 

3 

FORMES 

FOR  SEMANA 

FOR  DIA 

Im 
en  el 

BCS 

psado 

25 
en  d 
na 
paudo 

1  m 
tftftini 

2 

PW 

P" 

P" 

I 

por 
día 

24^ 

día 

2 

s. 

S 

FORMES 

FOR  SEMANA 

POR  DIA 

In 
en  d 
mes 
paudo 

25 
en  d 
na 
psado 

9<* 

2 

5-4 

POf 

aeiBina 

Vé 

P" 
•enana 

1 

P" 
día 

2+ 

P» 
día 

OJAIÍTO 

Medíalo 

-8 
1 

OJANTO 

8 
5 

e 
S 

z 

•8 

1 

Page  1 


<?::>"SW:->::Sv:':-.-."í:-:':-?:-:-:'; 
':':":':v:-?:         'l\*-:->i'<^  ■:^<'<&í:->:í 

íiii  ^ii:  ^ií: 
 ^ii^  Í^SiS  SiiÜ^iSiiiSíiS? 


•^>^^^'^^^^í^^^»^>^: 


i>or  Favor  No 


D 


n  ■  \- 


□I 


11  í  1 1 


Scale  75%  of  onginal 
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Block  FFQ  for  Children  (Spanish  Version)  Page  2 


Nombre  del  Niño/a: 

¿ 

Qué  Tan  Seguido  en 
las  Ultimas  4  Semanas? 

etraniAa*                      ,     -\     ^  *  ,  -^ji 

¿Cuánto 

Cada  Vez?                   .     ^  '  ^ 

3 

e 
o 
ac 

3 

POR  MES 

POR  SEMANA 

POR  DIA 

í^omioas  i^ue 
Niño/a  Comió  en  las 
Ultímas  4  Semanas 

I«a 
es  d 
mes 
ptudo 

2-5 
en  d 
ma 

1 

2 

P" 
Mmutt 

pw 
tauni 

P» 
Mnuni 

1 

P" 
dá 

2-1^ 

P« 

dú 

3 

s 

o 
i 

1 

^^^^^^^^^^^ 

17 
18 
19 
20 
21 
22 

Cereal  cocido,  comida  de 
niños  cereal  caliente 

Cereales  fríos,  como  Checrios, 
con  o  sin  leche 

Leche  en  cereal 

Azúcar  en  cereal 

Cnchandiias 

1  1  2  |3+ 

Huevos/blanquillos 

Hu«vos 

1  |2|3. 

— 1 — 1 — r^^"^ 

^     1   ^ 

TodmctaAocino,  salchichas 

¿Cuánto? 

1  i  2  |3+ 

■  <^  n ;v  .->♦  >  ^  *  r 

í 

a 
z 

FORMES 

POR  SEMANA 

POR  DIA 

OJAOTO 

l«ez 
OI  d 
Ba 
piudo 

2-5 
en  d 
no 
psido 

1  >ei 
por 
loBua 

2 

por 

M 
P" 
lonani 

5^ 
P« 
fomni 

1 

P" 

2* 
P» 

e 

o 

e 

z 

-8 

1 

23 
24 
25 
26 
27 
28 
29 
30 
31 
32 

EsfKigheti  con  salsa 
de  tomate 

Hamburguesas,  hamburguesas 
con  queso,  burritos  de  res,  tacos 

.■>?LJLJLÍ 

Bistec  o  rosbií/camc  de  res, 
costillas 

 ]  I  "ir 

Caldo  de  res 

Hígado  incluyendo  hígado 
de  pollo 

Cerdo  incluyendo  chuletas, 
asados,  puerco/marrano 

Pollo  frito 

Otro  ptoUo  (pollo  en  caldo, 
horneado  o  asado) 

Sandwich  de  atún  o 
"tuna  casserole' 

Pescado  o  sandwich  de 
ftcscado 

«             0             0              1              1             2             2             3  4 

Page  2 

^  ^  H 1^  ^ 
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WIG  Dietary  Assessment  Validation  Study 
Final  Report  -  Sepcember  22.  1994 
Appendix  A 


Block  FFQ  for  Children  (Spanish  Version)  Page  3 


Nombre  del  Niño/a: 

¿ 

Qué  Tan  Seguido  en 
las  Ultimas  4  Semanas? 

Compando  t 
Giras  rUSos 

¿Cuánto 
Cada  Vez? 

s                     ^^^^  \s\s^ 

í 

a 
z 

3 

FORMES 

POR  SEMANA 

POR  DIA 

OJAVrO 

comidas  v^ue 
Niño/a  Comió  en  las 

I  TlfifTiíi€  Á  ^/*fnonQc 

1  «a 
a  d 
mes 
paudo 

2-5 
a  d 
mes 
paudo 

2 

POf 

vé 
P«» 

1 

P« 

24 

P<* 

Aim 
CU 

s 

e 

a 

=8 
z 

1 

33 
34 

35 

36 

37 
38 
39 
40 

Fríjoles  como  fríjol  pinto  o 
rcfrítos  o  habichuelas 

Arroz 

'Chili  con  carne*  estilo 
amerícano 

Sopa  o  caldo  de  verduras/ 
vegetales  o  tomates  no 
incluyendo  res  o  pollo 

;•:•;■:■:■;•;%•>?:•;;                             ■•  ^ 

Otras  sopas  o  caldos 

Pizza 

Rebinadas 

1  1  2  |3+ 

Jamón,  fiambres,  carnes  frías, 
carne  de  lonche 

Rebinidas 

1  1  2  |3+ 

Hot  dog/perro  caUente 

Hot  Dogs 
1  1  2  |3+ 

i 

1 

FORMES 

POR  SEMANA 

PORDU 

OJAl^O 

-  •■  '  ^; 

1  «a 
(B  d 
mes 
pmtáa 

J-5 
es  d 
mes 
paudo 

1  «a 
•eaani 

2 

H 

KfUfU 

V6 
por 
xmini 

1 

P« 

dú 

2+ 
POf 
díi 

S 

o 

s 

■s 

z 

■« 

1 

41 

42 
43 
44 
45 
4€ 
47 
48 

49 

Panecillos,  bizcochos/ 
bisque  tes 

N                                 ^           ,  'ftl 

Pan  de  maíz,  panecillos 
de  maíz 

Margarina  o  mantequilla 

Queso  y  queso  crema 

Platillos  con  queso  incluyendo 
macarrón  con  queso 

Salsa,  ketchup,  chiles  rojos 
picantes 

m.- 

Pan  incluyendo  sandwiches, 
bagels  y  pan  de  hamburguesa 

Cadivez 

1  1  2  |3+ 

Tortillas  de  maíz/masa 

Tort31u(ci<i«>) 

1  1  2  |3. 

Tortillas  de  harina 

1  1  2  |3+ 

C             0             0              1              1              2             2             3  4 

Page  3 
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^  ^  «  J  1  ; 
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Block  FFQ  for  Children  (Spanish  Version) 


Page  4 


Nombre  del  Niño/a: 


¿Qué Tan  Seguido  en 
las  Ultimas  4  Semanas? 


Comidas  Que  Su 
Niño/a  Comió  en  las 
Ultimas  4  Semanas 


Bocaditos  salados  como 
papius  fñus,  palomius  de 
maíz,  chicharrón  de  puerco 


Mamca/cacahuates,  mantequilla 
de  maní/crema  de  cacahuate 


Helado/tiicvc/mantccado, 
budín/pudín 


Yogtirt  o  yogurt  congelado 


Donas,  pan  dulce 


Pastel,  Cortas,  galletas 


56  Dulce  de  chocolate 


57 


58 


59 


Jugo  de  naran)a/china 


Jugo  de  manzana  o  de  uva 


Kool-Aid  o  bebidas  de  fruu, 
aguas  frescas 


Leche  descremada/"  lowíai' 
(sin  incluir  leche  en  cereal) 


Leche  cntcray" whole" 
(sin  incluir  leche  en  cereal) 


Sodas  (sin  incluir  sodas 
de  dieu) 


CooparKlo  « 
otra  nlAot 

¿Cuánto 
Cada  Vez? 


1 

z 

FORMES 

POR  SEMANA 

POR  DIA 

1  *□ 
en  d 
na 
peído 

2-3 
ta  d 
no 
jmtáo 

1  va 

P«f 
icmina 

2 

pw 

pw 

Vé 
P» 

PW 

dtt 

2+ 

P» 
dú 

0             0             0             t              1             2             2             3  4 

9 
Z 

3 

15 
cu  d 
mes 
paudo 

POR  SEMANA 

PORDU 

1  «a 
semaiu 

14 
por 
aemtni 

P" 

1 

P« 
dú 

2 

POf 
dU 

U 
P» 
dú 

5^ 

P» 
dú 

CUANTO 

o 
S 

z 

Gnnde 

OJANTO 

Chico 

o 

a 

•s 

z 

Page  4 


i»\  ■.^•.^■■í  ,\<,  ^  '•vis 


□ 


I  I 
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Block  FFQ  for  Children  (Spanish  Version)  Page  5 


Nombre  del  Niño/a:                                                      'i^ftwoc  No  -  J 

¿Durante  las  últimas  4  semanas,  cuántas     ' '              ^    ^  ^  - 

e 

i 

POR  SEMANA 

POR  DIA 

..."                                   ^  \- 

Vitaminas  Múltiples 

HkJoru,  tabletas,  o  en  líquido 

1-5 

4^ 
pof 

1 

pof 

2 

P» 

5 

P» 
dtt 

4 

P» 
díi 

5+ 
P" 
dú 

63 

Vitaminas  múltiples  como  Vitamina 
Una  al  Día,  vitaminas  para  niños 

Ningún  1 

POR  SEMANA 

POR  DIA 

Sííí-<..-"xxt-  <-í>x\  í'X'=XAsr|Xí!.V'?  -»x  <^x, 
-v-xx""-"  xx-'Xs.xoxx-^-Sí-í-xxxx.  x-^í -r 

64 
65 
66 

67 

66 

Vitaminas  Individuales 

PSldons,  ubletas,  o  en  líquido 

15 
lemini 

4-6 
P" 

1 

por 
dú 

2 

por 
áu 

5 

dú 

4 

P« 
dú 

5+ 
P» 
dú 

PíldorasAablctas  de  hierro 
Piidoras/tablctas  de  calcio 

Vitamina  E 
Vitamina  C 

^x:  .oi  X-     í ♦  i  ^ 

>     -  "x                 "    -^^  -        -  \ 

¿Si  su  niño/a  toma  Vitamina  C,  cuántos  miligramos 
de  Vitamina  C  tiene  cada  pildora? 

100 

250 

500 

1000 

No 
Si 

iiiliiiiÉiliiiiliili^iliiip 

S      V       V                                      ~  ,  

¡Gracias  por  completar  este  cuestionario!  | 

Page  1  1 
Page  2  I 
P»ge3    i  I 
Page  4    :  1 
TOTAL  : 

^              ^           ■    i  ^ 
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APPENDIX  B 


HARVARD  FOOD  FREQUENCY  QUESTIONNAIRE 


Harvard  FFQ  Administration  Instructions 

Harvard  FFQ  Manual  Scoring  Templates 

Cover  Page  for  Harvard  FFQ  (Women's  English  Version) 

Harvard  FFQ  for  Women       (English  Version) 

Harvard  FFQ  for  Women      (Spanish  Version) 

Harvard  FFQ  for  Children     (English  Version) 

Harvard  FFQ  for  Children     (Spanish  Version) 


Important  Note:  The  actual  Harvard  Women 's  and  Children 's  questionnaires  have  the 
alternate  items  printed  on  a  shaded  background  to  facilitate  reading  across  the  frequency 
response  categories.  This  is  an  important  design  feature  which,  unfortunately,  could  not 
be  faithfully  photo-copied  on  the  examples  printed  in  this  Appendix.  The  questionnaires 
used  in  this  validation  study,  obtained  directly  from  Harvard  School  of  Public  Health, 
had  the  shaded  items  on  them.  An  example  of  alternate  shaded  items  can  be  seen  on  the 
Block  FFQs  in  Appendix  A. 


The  Harvard  Food  Frequency 
Questionnaires  can  be  purchased  from: 

Dr.  Jane  Gardner 

Department  of  Maternal  and  Child  Health 

Harvard  School  of  Public  Health 

677  Huntington  Avenue 

Boston,  Massachusetts  02115 

(617)  432-1080 

Fax  (617)  432-3755 

E-mail:JGardner@HSPH.HARVARD.EDU 
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Harvard  FFQ 


Administration  Instructions 


Raeonandad  varbal  Instruetion  for  Adalalstarlng  tba 
Voaaa's  aad  Chlldr«B's  rood  rraquraey  Quastienaalras 


1.  Fill  in  the  client  identification  infornation  in  the  upper 
right  hand  corner.    Be  sure  to  fill  this  in  completely  as 
the  inforaation  is  necessary  to  carry  out  the  analyses. 

2.  Provide  the  appropriate  questionnaire,  clipboard,  and 
pencil.    Say  to  the  woman, 

"This  is  the  form  we  would  liXe  you  to  fill  out.     It  has 
three  sides.    We  want  you  to  think  about  what  you  ate  (or 
your  child  ate)  during  the  last  four  weeks.    He  Icnow  you 
can't  remember  exactly,  but  you  probably  have  a  good  idea." 

Read  the  direction  on  the  form  aloud  while  pointing  to  them. 

"You  select  how  often  you  ate  the  food  from  zero  times  in 
the  last  four  weeks  to  six  or  more  times  each  day,"  [point 
to  the  scale  above  the  columii] . 

"Suppose  you  (or  yo\ir  child)  drank  one  glass  of  milk  [point 
to  milk]  everyday  [point  to  per  day].    Then  you  put  an  X  or 
a  check  here  [point].    This  column  is  for  foods  you  had  just 
one  to  three  times  in  the  last  four  weeks  [point]." 

"We  are  asking  about  serving  of  food,  not  tastes.     So  if  you 
put  an  X  here  [point  to  ice  cream,  6-t-/day],  that  would  say 
that  you  had  eaten  six  or  more  bowls  of  ice  cream  every  day 
for  the  past  four  weeks.     Use  this  column  only  for  foods  you 
ate  a  lot  of  every  day.    Remember  to  make  a  mark  in  this 
column  [never]  if  you  did  not  eat  the  food.     It  helps  you  to 
keep  your  place  and  it  helps  us  to  )cnow  that  you  did  not 
forget  a  food." 

3.  Watch  as  th«  client  fills  out  the  first  three  foods  to  be 
sure  she  understands  the  instructions. 


4.      Collect  the  finished  form  and  check  for  errors  in 

completion,  i.e.,  pages  or  rows  not  filled  in,  double  marked 
rows,  number  of  eggs. 


Scale  75%  of  ohgiiial 
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Harvard  FFQ  Manual  Scoring 


Template  1 


Template  to  Score  Women's  and  Children's  Nutrition  Questionnaires 


Pl«a««  Follow  thm  Oiractlona  La  tha  Ordar  GlTan 


Milk  Pr«Mlucta  and  Fruits 

1.  Placa  this  tamplata  on  Page  1  «o 
that  the  t%ra  ahadacl  boxea  ahow 
through  the  holes  in  the  template. 

2.  Count  the  chacka  in  each  column, 
and  write  the  numbera  in  the  boxea 
beneath  each  column. 

3.  Uaing  the  colora  above  the  boxea 
and  the  numbera  in  the  boxea, 

compare  with  the  following 
combinationa  for  a  match  working 
from  right  to  left.  Once  a  match 
ia  found,  mark  the  shaded  box  on 
the  queationnaire  with  the  aymbol 
in  the  gray  box  (X  or  -)  next  to 
the  matched  combination. 

In  the  combinationa,  any  number 
that  crosses  two  or  more  small 
boxes  ia  the  TOTAL  of  those  amall 
boxea . 

4.  Once  you  have  marked  the  ahaded 

box,   go  to  the  next  food  group.* 


Kilk  Products  CoabLnrntions 


1  \  1 

4 

21 

X 

22 

0 

X 

22 

1 

0 

X 

21 

1 

1 

0 

X 

2 

0 

1 

1 

0 

X 

23 

0 

0 

X 

No  match 

7rvi.cs  Coabiiiaciona 

£10 

21 

X 

22 

0 

X 

24 

1 

0 

X 

2.1 

3 

1 

0 

X 

23 

2 

1 

0 

X 

25 

1 

1 

0 

X 

27 

0 

1 

0 

X 

27 

0 

0 

X 

22 

6 

0 

0 

X 

24 

S 

0 

0 

X 

26 

4 

0 

0 

X 

8 

3 

0 

0 

X 

No  match 

The  ahaded  box  with  the  mark  rx| 
indicates  the  minimum  intaxa  haa 
bean  mat  or  exceeded. 
The  ahaded  box  with  the  mark 
indicates  the  minimum  intake 
not  been  met . 


Li 


r  -  -  T 
I.  .  .  J 


Copynjht  1991,  Harvard  School  of  Public  Health 


Scale  7S%  ofonginal 
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Harvard  FFQ  Manual  Scoring 


Template  2 


VagatAblas 

1.  Place  this  tnoplat*  on  Pag*  2  so 
thac  tha  «hadad  box  ahowa  through 
tha  hola  in  cha  tamplaca. 

2.  Count  tha  chccka  in  aach  colunn, 
and  writa  tha  numbara  in  tha  boxaa 
banaath  aach  column. 


Paga  2 


Multiply 
lar  B2 


tha  numbar  in  tha  box 
undar'B2  by  2.  Add  that  raault  to 
th«  numbar  in  tha  box  undar  Bl, 
anc  writa  tha  aum  in  the  circle. 

4.  Using  the  colora  above  the  boxea, 
the  numbara  in  the  boxea,  and  the 
cxrcla,  compare  with  the  following 
coffibinationa  for  a  match  working 
from  right  to  left.  Once  a  match 
ia  found,  mark  tha  ahadad  box  on 
the  guaationnaire  with  tha  aymbol 
in  tha  gray  box  (X  or  -)  next  to 
the  matched  combination. 

In  the  combinations,  any  number 
that  crosaea  two  or  more  amall 
boxea  ia  the  TOTAL  of  thoae  small 
boxea . 

5.  Once  you  have  marked  the  shaded 
box  go  to  tha  next  food  group.* 

Vagacabiaa  Cnmhfnatioits 


1    1    1  1 

25 

(  ) 

0 

0 

(  ) 

22 

X 

(  ) 

21 

1 

X 

(  ) 

íi 

Ó 

X 

(  ) 

£2 

i 

ó 

X 

<  i2) 

1 

2 

ó 

X 

(  i7) 

Ó 

■  i 

ó 

X 

(  ) 

ii 

1 

ó 

X 

(  22) 

2 

1 

0 

X 

(  29) 

1 

1 

0 

X 

(214) 

Ó 

1 

ó 

X 

(  ) 

25 

0 

ó 

X 

<  21) 

4 

0 

ó 

X 

(  26) 

3 

0 

ó 

X 

(211) 

2 

ó 

0 

X 

(216) 

1 

0 

0 

X 

(221) 

Ó 

0 

0 

X 

No  match 

Bl 

B2 

r  

:  -  Bl 


•«■  (  B2  X  2  ) 


The  ahadad  box  with  the  mark  JX] 
indicates  the  minimum  intaxa  has 
been  met  or  exceeded. 
The  shaded  box  with  tha  mark  (-) 
indicates  the  minimum  intana  has 
not  bean  mac. 


Copyhsht  1991,  Harvard  School  of  Public  Health 
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Template  3-1 


1.  Place  thlB  tcinplkte  on  Page  3  mo 
that  the  ahaded  box  ahowa  through 
the  hole  in  the  template. 

2.  Count  the  checka  in  each  column, 
and  write  the  numbers  in  the  boxea 
beneath  each  column. 

3.  Make  an  adjustment  for  egga  by 
adding  1  to  the  number  of  one  box, 
as  shown  below: 


Page  3-1 


Number  of 
egga/wk 


Women 


Children 


2  or  3 
4 

S  or  more 


None 

*1 


+1! 


+1 


4.  Using  the  colors  above  the  boxes 
and  the  numbers  in  the  boxes, 
compare  with  the  following 
coffibinationa  for  a  match  working 
from  right  to  left.  Once  a  match 
is  found,  mark  the  shaded  box  on 
the  questionnaire  with  the  symbol 
in  the  gray  box  (X  or  -)  next  to 
the  matched  combination. 

In  the  combinations,  any  number 
that  croases  two  or  more  small 
boxes  is  the  TOTAL  of  those  small 
boxea. 

5 .  Once  you  have  marked  the  shaded 

box,  go  to  the  next  food  group.* 


KmmtM  Combin*tj.onM 


1 

0 

0 

21 

X 

22 

0 

X 

22 

1 

ó 

X 

21 

1 

1 

ó 

X 

6 

1 

1 

ó 

X 

23 

Ó 

0 

X 

22 

2 

0 

0 

X 

£2 

1 

2 

6 

0 

X 

24 

0 

i 

0 

ó 

X  1 

25 

1 

ó 

0 

X  1 

21 

4 

1 

ó 

0 

X  1 

23 

1 

ó 

ó 

X  1 

25 

2 

1 

0 

0 

X  1 

7 

1 

1 

0 

0 

X  1 

27 

Ó 

0 

0 

X  1 

22 

6 

0 

0 

ó 

X  1 

4 

5 

0 

ó 

ó 

X  j 

No  match 

The  shaded  box  with  the  mark 
indicates  the  minimum  intake 
been  met  or  exceeded. 
The  ahaded  box  with  the  mark 
indicates  the  minimum  intake 
not  been  met. 


Lli 


2-3 

24 

+  1 

■♦•1 

1 

♦  1 

♦  1 

♦  1 

1 

2-4 

2S 

Eggs 


Children 
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Template  3-2 


Oralas 


Pag*  3-2 


Place  this  tamplatc  on  Paga  3  ao 
that  the  ahadea  box  shows  through 
the  hola  in  the  template. 

Count  the  checks  in  each  column, 
and  write  the  numbers  in  the  boxes 
beneath  each  column. 

Using  the  colora  above  the  boxes 
and  the  numbers  in  the  boxes, 
compare  with  the  following 
combinations  for  a  match  working 
from  right  to  left.  Once  a  match 
is  found,  mark  the  shaded  box  on 
the  questionnaire  with  the  symbol 
in  the  gray  box  (X  or  -)  next  to 
the  matched  combination. 

In  the  combinations,  any  number 
that  crosses  two  or  more  small 
boxes  is  the  TOTAL  of  those  small 
boxes . 


Grain*  Cnmh i  nations  1 


1  1  1  1  1  1  1  1  II 

1         0       ¡I  - 

1        1        1  II 

If  you  have  marked  the  shaded  box, 
stop.*  Otherwise,   continue  the 
following  steps. 

Multiply  the  numbers  in  the  boxes 
by  the  numbers  shown  on  the 
template,   and  write  the  results  in 
the  circles  above  the  boxes.  Add 
the  values  in  the  circles  under 
the  yellow,   and  write  the  sum  in 
the  whit*  box.  Add  the  values  in 
the  circles  under  the  green,  and 
write  the  sum  in  the  box  under  the 
blue. 


6.  Compare  the  numbers  in  the  whit* 
box  and  the  box  under  the  blue 
with  the  following  combinations 
for  a  match  working  from  right  to 
left.  One*  a  match  is  found,  mark 
the  ahadad  box  on  th* 
questionnair*  with  the  symbol  in 
the  gray  box  (X  or  -)  next  to  the 
matched  combination. 

7.  Once  you  have  marked  the  gray  box, 
stop. * 


Graxns  Coiwhf  nations  2 




£6 

X 

27 

5 

X 

£14 

4 

X 

£21 

3 

X 

£26 

2 

X 

£35 

1 

X 

£42 

0 

X 

No  match 

The  ahaded  box  wich  the  mark  [X] 
indicates  the  minimum  intake  has 
been  mer  or  exceeded. 
The  shaded  box  with  che  mark  r-) 
indicates  the  minimum  intake  has 
not  been  met. 


r 


LT.T 


1 

X2 

k5 

x2 

x4 

r  -  - 
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Women's  English  Version 


Foods  You  Ate  in  the  Past  4  Weeks 


Your  Name: 


This  form  will  take  about  15  minutes  to  complete. 


OMI  DisdMurc  SUlcnenl 

Public  rqmrting  borden  for  this  coUedlon  of  Informioon  is  esbinited  to  vuy  (rom  10  ■  2$  miirales  per  response,  Including  (he  lime 
for  revimng  insnclions,  setrching  oisting  diu  source,  giibering  ind  rniiniainiog  the  diu  needed,  ind  compleling  tnd  revi^ring  the 
collection  of  information.  Send  cooments  regirding  (his  burden  estímale  or  any  oúier  aspect  of  (his  collection  of  information,  including 
SDggestlonsforredDclngthisbardenloDepartmeniof AgncoltureOaranceOScerOIRM.  Room,404-W.  Vishington, D.C 20250; and (o die 
Office  of  Management  and  Budget  Paperwork  Reduction  Profea  (0MB  NO  OS 78-0018),  Washington,  D  C  20903. 
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Women's  Nutrition  Questionnaire 
What  Have  You  Been  Eating  Lately? 

During  the  past  4  weeks,  how  often  did  you  eat 
a  serving  of  each  of  the  foods  hsted  here? 
Mark  only  one  X  for  each  food 

Nnmp 

Tn 

natp 
DOR 

Pregnant                            [  ] 

Breastfeeding                       [  ] 
Ist  6  months 

Breastfeeding                       [  ] 
2nd  6  months 

Not  Breastfeedmg                 [  ] 

Iaat4 
weeks 

each  week 

each  day 

1 
2 
3 
4 
5 
6 

Number  of  tames 

0 

1-3 

1 

&€ 

1 

2-3 

4-5 

6  + 

Milk 

Hot  chocolate 

Cheese,  plain  or  in  sandwiches 

Yogurt 

Ice  cream 

Pudding 

What  kind  of  milk  do  vou  drink? 

f   1  whole 

u 

[  ]lowfat 
[  ]  skim 

last4 
weeka 

each  week 

each  day 

7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 

Number  of  times 

0   !  1-3 

1 

5-6 

1 

2-3 

4-5 

6  + 

Orange  or  grapefiruit 

Orange  juice  or  grapefruit  juice 

Apple  juice 

Other  fruit  drinks  (Hi-C,  Kool-aid,  lemonade) 

Banana 

Apple  or  applesauce  i 

Grapes 

Peaches 

Strawberries 

Cantaloupe 

Watermelon 

Pineapple 

Raisins  or  prunes 

□ 
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Mark  only  on«  X  for  each  food 

How  often  did  you  eat  a  serving  of  these  foods  during  the  past  4  weeks? 


last  4 
weeks 

each  week 

each  day 

Number  of  tunes 

0 

1-3 

1 

5-6 

1 

2-3 

4-5 

6  + 

Com 

20 

Peas  (canned,  frozen,  or  fresh) 

21 

lb  ma  toes 

22 

Peppers  (green,  red,  hot) 

23 

Carrots 

24 

Broccoli 

25 

Green  beans 

26 

Spinach 

27 

Greens  (mustard,  turnip,  collards) 

28 

Squash,  oreinge  or  winter 

29 

French  fries,  fried  potatoes 

30 

Potatoes  (baked,  boiled,  or  mashed) 

31 

Sweet  potatoes  or  yams 

32 

Cabbage  or  coleslaw 

33 

Lettuce  salad 

34 

Salad  dressing  or  mayonnaise 

35 

 1  □ 

o 


last  4 
weeks 

each  week 

each  day 

Number  of  times 

0 

1-3 

1 

2-4 

5-6 

1 

2-3 

4-5 

6  + 

Chips  (potato,  com,  others) 

36 

Nuts 

37 

Cookies  or  brownies 

38 

Cake  or  cupcake 

39 

Pie  (pumpkin,  sweet  potato,  or  squash) 

40 

Other  pie 

41 

JeUo 

42 

Chocolate  candy 

43 

Other  candy 

44 

Coffee  or  tea  | 

45 

Soft  drinks 

46 

Sugar-free  soft  drinks  ¡ 

47 
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Mark  only  one  X  for  each  food 

How  often  did  you  eat  a  serving  of  these  foods  during  the  past  4  weeks? 


la«t4 
weeks 

each  week 

each  day 

Number  of  times 

0 

1-3 

1 

2-4 

&« 

1 

2-3 

4-5 

6  + 

Baked  beans  or  chili  beans 

Other  dried  beans,  peas,  or  Lima  beans 

Rice 

Spaghetti  or  other  pasta  with  sauce 

Pizza 

Macaroni  and  cheese 

Hot  dogs 

Hamburgers,  meatballs,  or  meatloaf 

Canned  tima 

Cold  cuts  (baloney,  ham,  salami) 

Peanut  butter 

Bread,  toast,  or  rolls 

Margarine  or  butter 

Chicken  or  turkey 

Pork  chops,  roast  po^  or  ribs 

Steak  or  roast  beef 

Fish 

Liver 

Sausage 

Bacon 

Hot  cereal  or  grits 

Cold  breakfast  cereal 

Donut 

Sweet  roll  or  muffin 

Pancake,  waüle,  or  French  toast 

English  muffin  or  bagel 

Biscuit 

Combread  or  tortillas 

Vegetable  soup 

Other  soup 

Crackers 

How  many  eggs  do  you  eat  in  one  week?   f  j 

.  ;--)-y-|-"--p-|^  Q 

oooooo  uu 

1   !   I  I   I   I   1^  □ 
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Cuestionario  de  Nutrición  de  Mujeres 

¿Qué  ha  estado  usted  comiendo  liltimamente? 

¿Durante  las  últimas  4  semanas,  qué  tan  a  menudo  comió 
usted  una  porción  de  cada  alimento  en  la  lista  que  sigue? 
Marque  solamente  una  X  por  cada  comida 

Nnmhr»» 
TD 

Fecha 

Fprha  He  Nacimiento 
Embarazada                        [  ] 
EDC 

Ulo  el  recno                          i  j 
Los  primeros  6  meses 

Dió  el  Pecho                         [  ] 
Los  segundos  6  meses 

No  Dió  el  Pecho                    [  ] 

últimas  4 
■emanas 

cada  ■emana 

cada  día 

1 
2 
3 
4 
5 
6 

Numero  de  veces 

0 

1-3 

1 

5-6 

1 

4-5 

6-^ 

Leche 

Chocolate  caliente 

Queso,  sólo  0  en  sandwich 

Yogurt 

Helado,  nreve 

Budín,  pudín 

;Oué  clase  de  leche  bebe  usted? 

Í  1  leche  entera 

1  1 

1  1 

[  ]  leche  parcialmente  descremada  (lowfat) 
[  ]  leche  descremada  0  desnatad  (nonfat) 

últimas  4 
■emanas 

cada  ■emana 

cada  día 

7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 

Numero  de  veces 

0 

\-3 

1 

5-6 

1 

4-5 

6  + 

China  (naranja)  o  toroi^a 

Jugo  de  china  (naranja)  o  jugo  de  toronja 

Jugo  de  manzana 

Otros  jugos  de  frutas  (Hi-C,  Kool-aid.  lemonada) 

Guineo,  plátano  o  banano 

Manzana  o  puré  de  manzana  i 

Uvas 

Melocotón,  durazno  i 

Fresas 

Melón  i 

Sandía,  melón  de  agua 

I 
1 

Piña                                                         ,  1 

Pasas  0  ciruelas 
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Marque  solamente  una  X  por  cada  comida 

¿Qué  tan  a  menudo  comió  usted  una  porción  de  ellos  alimentos  en  las  últimas  4  aemanas? 

líltÍMWQ  4 

■emanas 

cada  ■emana 

cada  día 

Número  de  veces 

0 

1-3 

1 

2^ 

1 

4-5 

Maíz,  elote 

20 

Guisante,  chícharo  (enlatado,  congelado  o  fresco) 

21 

Tomates 

22 

Pimientos  (verde,  rojo  o  picante) 

23 

Zanahoria 

24 

BroccoU  0  brécol 

25 

Habichuelas  verde,  cgote 

26 

Espinaca 

27 

Verduras  (nabo  o  acelga) 

26 

Calabaza 

29 

Papas  fritas 

30 

Papas  (asada  o  hervida  o  en  puré) 

31 

Batata  o  ñame,  camote 

32 

Repollo  o  ensalada  de  col 

33 

Ensalada  de  lechuga 

34 

Aderezo  para  ensalada  o  mayonesa 

35 

1  1 

1  1 

1  1 

O 

iUtimas4 

cada  ■emana 

cada  día 

Número  de  veces 

0 

1-3 

1 

5-6 

1 

6-f 

Papilas  fritas,  doraditas.  chips  de  maíz  o  otras 

36 

Nueces 

37 

Galletas 

38 

Bizcocho,  bizcochito  redondo,  pastel 

39 

Pastel,  pie  o  empanada  (calabaza  o  camote) 

40 

Otro  pastel,  pie  o  empanada 

41 

Jaleas,  mermeladas 

42 

Diilce  de  chocolate 

43 

Otros  dulces 

44 

Cafe  0  té 

45 

Refrescos 

46 

Refrescos  sin  azúcar 

47 
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Marque  solamente  una  X  por  cada  comida 

¿Qué  tan  a  menudo  comió  usted  una  porción  de  ellos  alimentos  en  las  líltimas  4  semanas? 


últimas  4 
■emanas 

cadj 

■  semana 

cada  dia 

Numero  de  veces 

0 

1-3 

1 

7-i 

1 

2-4 

4-5 

6  + 

fXaDlCnUcIBS  aBoGiaa  CUU  cnUc,  inJOlcS  gulBaUUtt 

48 

OtrtLS  h&bichucl&S,  frijoles  secos,  ^uisuitc,  chmro  o  hftbfl 

49 

50 

TTcnxiOTiPtti  11  ntrn  nnQtj)  pnn  Qnlcn 

51 

52 

iviaCcu  I unea  con  i^ucsu 

53 

not  uOg 

54 

Hsunbur^uesH,  albóndiga  o  carne  mechada,  deahebrada 

55 

Atún  de  lata 

56 

Fiambres  (bolognfi,  jEmón,  salflmi ),  carnes  frías 

57 

Mamtecfuilla  de  maní,  cacahuate 

58 

Pan,  tostado  o  bolillos 

59 

ftilar^anna  o  mantec^uilla 

60 

Pollo  0  pavo 

61 

i^nuicLas,  came  ae  xcs  o  oosuiiao 

62 

63 

Pescado 

64 

1  <to  a  a 

65 

^2 A 1  f'W%  «  An  o  o 

66 

Tocino 

67 

Cereal  caliente,  avena  o  atole 

68 

Cereal  frío  para  el  desayuno 

69 

Donas 

70 

Pan  dulce 

71 

Panqué,  hot  cakes  o  French  toast 

72 

English  muñin  o  bagel 

73 

Bizcocho,  bisquetes 

T 

74 

Pan  de  maíz  o  tortilla 

75 

Sopa  de  verdura,  caldo  de  verdura 

76 

Otras  sopas,  caldos  \ 

77 

Galletas  saladas  ! 

78 

¿Cuántos  huevos  come  usted  en  una  semana''  ^^^^ 

oooooo  nzi 

!  !  I  i  I  □ 

Copyn^t  1993.  Hanrmrd  School  of  Pubbc  HmíOi  3 

Scale  75%  of  onginal 


WIC  Dietary  Assessment  Validation  Study 
Final  Report  -  September  22,  1994 
AppeMllx  B 


Harvard  FFQ  for  Children 


Page  1 


Children's  Nutrition  Questionnaire 


What  Has  Your  Child  Been  Eating  Lately? 

E)uring  the  past  4  weeks,  how  often  did  your  child 
eat  a  serving  of  each  of  the  foods  hsted  here? 
Mark  only  one  X  for  each  food 


Name . 
ID  


Date. 
DOB. 
Age  _ 


Respondent 
Mother  [  ] 
Other    [  ]. 


Ust4 
weeks 

each  week 

each  day 

Number  of  tunes 

0 

1 

2-4 

5-6 

1 

2-3 

4-5 

6  + 

Milk 

Hot  chocolate 

Cheese,  plain  or  in  sandwiches 

Yogurt 

Ice  cream 

Pudding 

What  kind  of  milk  does  your  child  drink? 
[   ]  whole 
[   ]  lowfat 

I    ]  skim 
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:   laat  4 
1  weeks 

each  week 

each  day 

Number  of  tunes      0  ;  1-3 

I    12-4  15-6 

1   !  2-3 

4-5  1  6* 

Orange 

1  Orange  juice                                                 |  1 

Apple  jiuce 

j  Other  frujt  dnnks  (Hi-C.  Kool-aid,  lemonade  1  1 

I  1 

Banana 

1 

Apple  or  applesauce 

Grapes 

I 
1 

Peaches 

Strawberries                                               |  | 

1  Cantaloupe 

Watermelon  | 

1  Pineapple 

i 

Raisins 

□ 
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Mark  only  one  X  for  each  food 

How  often  did  your  child  eat  a  serving  of  these  foods  during  the  past  4  weeks? 

lm*t4 
weeks 

each  w 

eek 

each  day 

Number  of  times 

0 

1-3 

1 

2-4 

V6 

1 

2-3 

4-5 

6- 

Com 

20 

Peas  (canned  frozen,  or  fresh) 

21 

Tomatoes 

22 

Ppr^r^rc  ( orv^n   T^fi   hot ) 

23 

24 

Broccoli 

25 

VTIVCO  Or-ttltn 

26 

Spinach 

27 

Greens  (mustard,  turnip,  collards) 

28 

Squash,  orange  or  winter 

29 

French  fries,  fried  potatoes 

30 

Potatoes  (baked,  boiled,  or  mashed) 

31 

Sweet  potatoes  or  yams 

32 

Cabbage  or  coleslaw 

33 

Lettuce  salad 

34 

Salad  dressing  or  mayonnaise 

35 

1  1 

1  1 

O 

t 

Uct  4 
we«kj 

each  week 

each  day 

Number  of  timet 

0 

1-3 

1 

5-6 

1 

2-3 

4-5 

6* 

Chips  (potato,  com,  others) 

36 

Nuts  ! 

37 

Cookies  or  brownies  [ 

1  

1  

38 

Cake  or  cupcake                                          1  i 

39 

Pie  (pumpkin,  sweet  potato,  or  squash) 

40 

1  Other  pie 



41 

JeUo 

42 

Chocolate  candy 

43 

Other  candy                                               1  | 

44 

Tea 

i 

45 

Soft  dnnks  | 

46 

Sugar-free  soft  dnnks 

47 
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Mark  only  one  X  for  each  food 

How  often  did  your  child  eat  a  serving  of  these  foods  during  the  past  4  weeks'* 


Ust4 
weeks 

each  week 

each  day 

Number  of  times 

0 

1^ 

1 

1 

2-3 

6- 

Baked  beans  or  rhili  beans 

48 

Other  dried  beans,  peas,  or  Lima  beans 

1 

1 

49 

Rice 

50 

Spaghetti  or  other  pasta  with  sauce 

51 

Pizza 

52 

Macaroni  and  cheese 

1 

53 

Hot  dogs 

54 

Hamburgers,  meatballs,  or  meatloaf 

55 

Canned  tuna 

56 

Cold  cuts  (baloney,  ham,  salami) 

1 

57 

Peanut  butter 

58 

Bread,  toast,  or  rolls 

59 

Margarine  or  butter 

60 

Chicken  or  turkey 

I 

i 

61 

Pork  chops,  roast  pork,  or  ribs 

62 

Steak  or  roast  beef 

1 

63 

Fish 

64 

Ldver 

65 

Sausage 

66 

Bacon 

67 

Hot  cereal  or  grits 

68 

Cold  breakfast  cereal 

69 

Donut 

— j 

70 

Sweet  roll  or  muffin 

71 

Pancake,  waffle,  or  FVench  toast 

72 

English  muffin  or  bagel  ' 

1 

1 

73 

Biscuit 

i 

74 

Combread  or  tortillas 

1  1 

75 

Vegetable  soup 

76 

Other  soup 

1 

77 

Crackers 

1 

! 

78 

How  many  eggs  does  vour  child  eat  in  one  week''  _   

"""""""""i""""Tn  □ 

oooooo  r~] 

!  □ 
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Cuestionario  de  Nutrición  de  Niños 

¿Qué  ha  estado  comiendo  su  niño  últimamente? 

¿Durante  las  últimas  4  semanas,  qué  tan  a  menudo  comió 
su  niño  una  p>orción  de  cada  alimento  en  la  lista  que  sigue? 
Marque  solamente  una  X  por  cada  comida 

Nombre 
ID 

Fecha 

Fprha  de  Nacimiento 
EDAD 

Respondedor 
Madre  [  ] 
Otro    [  1 

últimaa  4 
semanas 

cada  semana 

cada  dia 

1 
2 
3 
4 
5 
6 

Numero  de  veces 

0   1  1-3 

1 

24 

5-6 

1 

24 

4-5 

6-t- 

Leche 

Chocolate  CEiliente 

Queso,  sólo  0  en  sandwich 

Yogurt 

Helado,  nreve 

Budín,  pudín 

¿Qué  clase  de  leche  bebe  su  niño? 

1 — n 
1  1 

[  1  leche  entera 

1 

I 

[  ]  leche  parcialmente  descremada  (lowfat) 
[  ]  leche  descremada  0  desnatad  (nonfat) 

1  últimas  4 

1  mmtnmnmm 

cada  semana 

cada  día 

7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 

Numero  de  veces  0 

1-3 

1 

24 

5-6 

1 

24 

4-5  1  6  + 

China  (naranja) 

Jugo  de  china  (naranja) 

Jugo  de  manzana 

Otrosjugos  de  frutas  (Hi-C.  Kooi-aid.  lemonada) 

1 

Guineo,  plátano  o  banano 

Manzana  o  puré  de  manzana                         '  1 

Uvas 

Melocotón,  durazno  1 

1 

Fresas  ¡ 

Melón 

Sandía,  melón  de  agua 

Piña  ' 

i  i 

Pasas 

Copyn^t  1993.  Harvard  School  of  Public  Health 
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Marque  solamente  una  X  por  cada  comida 

¿Qué  tan  a  menudo  comió  su  niño  una  porción  de  ellos  alimentos  en  las  últimas  4  semanas? 

últimas  4 
semanal) 

cada  semana 

cada  día 

Número  de  veces 

0 

1-3 

1 

2-4 

5-6 

1 

2-4 

4-5 

6  + 

Maíz  elote 

20 

Guisante,  chícharo  (enlatado,  congelado  o  fresco) 

21 

TDmates 

22 

Pimientos  (verde,  rojo  o  picante) 

23 

Zanahoria 

24 

Broccoli  0  brécol 

25 

Espinaca 

97 

Verduras  (nabo  o  acelga) 

28 

Calabaza 

29 

Papas  firitas 

30 

Papas  (asada  o  hervida  o  en  puré) 

31 

Batata  o  ñame,  camote 

32 

Repollo  0  ensalada  dé  col 

33 

Ensalada  de  lechuga 

34 

Aderezo  para  ensalada  o  mayonesa 

35 

1  1 

1  1 

1 
1 

O 

últimas  4 
Mmanas 

cada  semana 

cada  día 

N  limero  de  veces 

0 

1-3 

1 

5-6 

24 

4-5 

6* 

Papitas  fritas,  doraditas,  chipa  de  maíz  o  otras 

36 

Nueces 

37 

Galletas 

38 

Bizcocho,  bizcochito  redondo,  pastel 

39 

Pastel,  pie  o  empanada  (cnlaham  o  camote) 

40 

Otro  pastel,  pie  o  empanada 

41 

Jalean,  mermeladas 

42 

Dulce  de  chocolate 

43 

Otros  dulces 

44 

Te  ! 

45 

Refrescos 

46 

Refrescos  sin  azúcar  ¡ 

47 

Copyright  1993.  Harvard  School  of  PubiK  Health 
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Marque  solamente  una  X  por  cada  comida 

¿Qué  tan  a  menudo  conuó  su  niño  una  porción  de  ellos  alimentos  en  las  últimas  4  semanas? 


últimas  4 
■emanas 

cada  aemana 

cada  dia 

Número  de  veces 

0 

1-3 

1 

2-4 

1 

6  + 

Habichuelas  asadas  con  chile,  frijoles  guisados 

48 

Otras  habicnuelas,  frijoles  sea»,  guisante,  chicaro  o  naba 

49 

Arroz 

50 

Espagtietti  u  otra  pasta  con  salsa 

51 

Pizza 

52 

Macarrones  con  queso 

53 

Hot  dog 

Hamburguesa,  albóndiga  o  came  mechada,  deahebrada 

55 

Atún  de  lata 

56 

Fiambres  (bologna,  jamen,  salami ).  carnes  frías 

57 

Mantequilla  de  maní,  cacahuate 

58 

Pan.  tostado  o  bolillos 

59 

Margarina  o  mantequilla 

60 

Pollo  0  pavo 

61 

Chuletas,  carne  de  res  o  costillas 

62 

Bistec  0  rosbif 

63 

Pescado 

64 

Hígado 

65 

Salchichas 

66 

Tbano  1 

67 

Cereal  cahente,  avena  o  atole 

68 

Ceretü  frío  para  el  desayuno  i 

69 

Donas 

70 

Pan  dulce  1 

71 

Panqué,  hot  cakes  o  French  toast 

72 

English  muffin  o  bagel 

! 

1 

73 

Bizcocho,  bisquetes                                      ¡  | 

74 

Pan  de  maíz  o  tortilla 

1 

75 

Sopa  de  verdura,  caldo  de  verdura  j 

76 

Otras  sopas,  caldos 

77 

Galletas  saladas 

78 

¿Cuantos  huevos  come  su  niño  en  una  semana''  _   

'."""""rTTn  □ 

oooooo  ízn 
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Intake  Form   P^g^  ^ 


PLEASE  PRINT 

Your  Name: 

first  middle 

last 

Mailing  Address: 

Citv.  Zin: 

1. 

Do  you  have  any  children  ages  1  to  4  years  old? 

□  Yes  □  No 

If  Yes,  please  list  the  name,  birth  date  &  age  of  each  child: 

Name                                                      Birth  p?ite 

Age 

/ 

/ 

month 

day 

year 

years 

/ 

/ 

month 

day 

years 

/ 

/ 

monih 

day 

year 

years 

/ 

/ 

month 

years 

2. 

Do  you  have  any  children  less  than  1  year  old? 

□  Yes  □  No 

li  Yes,  please  ust  the  name,  birth  date  &  age  of  each  child: 

Name                                                      Birth  Date 

Age 

/ 

/ 

month 

day 

year 

months 

/ 

/ 

month 

day 

year 

months 

Are  YOU  breast-feeding  vour  child?                         O  Yes 

□  No 

During  the  next  month,  do  vou  plan  to  breast-feed  your  child? 

□  Yes 

1 — k 

LI  No 

□  Not  Sure 

3. 

Are  you  pregnant?                                      CD  Yes 

□  No 

Q  Not  Sure 

If  Yes.  when  is  vour  due  date? 

/ 

month 

day 

continue  on  other  side  * 
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4.  Are  you: 

QAfrican-American    OHispanic/Ladna  I^White 

□other: 

(specify) 

5.  Your  birth  date:              /  / 

Your  ape: 

years 

month         day  year 

Your  height:                     ft  in. 

Your  weight: 

lbs. 

6.  Do  you  smoke? 

□  Yes       □  No 

.7.  Have  you  been  on  WIC  anytime  during 
the  past  4  weeks? 

□  Yes       □  No 

Please  do  not  write  below 

1 Q  Eligible  child  (1-4  years  only) 
2Q  Pregnant 

3Q  PostDamun.  breast-feedine  iO- 12  months  onlv^ 

Q   Eligible,  not  selected 
0    Not  eligible:  (explain) 

4Q  Postnanum.  not  brcast-feedine  fO-6  mondis  onlv") 

TeleDhone:  (  ) 

Location: 

Davs/times: 

TelcDhone:  (  ) 

Location: 

Davs/times: 

Other  contact: 

Í  ) 

coDMct  name 

phone 

Child  selected  for  studv: 

chiM's  name 

Child's  Sex:    QM    QF              Biithdav:  / 

/  Apr. 

month 

day         year  years 

Knowledge  Of  child's  diet?  QYes    QNo         Child  on  WIC  last  4  wks?   QVes  QNo 

Plfticipanl  on 

SDCcial  Diet;     QNone   QWcicht  loss    ClDiabetic  QOdtcn 

(jpecijy) 

Aonointment:               /  / 

date  ttae 

Notes: 

Selected: 

/       /                        /         /  / 

/ 

today*  dafE                                FFQ         EIH  CAT 

SHE  PART* 

InUlu  Form  -  WIC  Dicury  Aucumeni  V>Ld>uon  Study.  USDA  Contna  «i}-}l9l-2-031.  Freonuux.  SuUivu  A  Co.  (7A3) 
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Consent  Form 


AGREEMENT 

The  purpose  of  this  study  is  to  test  some  food  survey  forms  to  see  how  well  these 
measure  what  kinds  of  foods  people  eat.  The  results  of  this  study  will  help 
improve  services  to  women  and  children  at  WIC  clinics  throughout  the  U.S. 

Your  participation  in  this  study  is  voluntary.  If  you  choose  to  participate,  all 
information  you  provide  will  be  confidential.  Your  participation  will  nol  affect 
your  WIC  status,  eligibihty  or  benefits  for  you  or  your  child. 

To  participate: 

•  You  must  have  a  working  telephone  where  you  hve. 

•  You  must  be  available  during  the  next  6  weeks. 

•  You  must  meet  other  qualifications  for  the  study  as  explained. 

•  You  must  complete  an  initial  food  survey  today  telling  us  about  what  you  (or 
your  child)  usually  eats.  This  will  take  about  20  minutes  to  complete. 

•  You  must  agree  to  complete  3  interviews  by  telephone  about  what  you  (or  your 
child)  ate  during  an  entire  day.  Each  interview  will  last  about  30  minutes. 

•  You  must  agree  to  return  to  the  WIC  clinic  to  complete  a  second  food  survey  in 
about  1  month.  When  you  have  completed  this  last  step,  you  will  be  mailed  a  $30 
money  order  within  10  days  to  cover  your  expenses  for  helping  with  this  study. 

If  you  have  any  questions  about  this  study  or  your  participation,  please  call  the 
WIC  Project  Assistant  at  1-800-777-0737  (toll  free). 


Your  appointment  to  complete  the  second  survey: 


Date  Time 


/  have  read  and  understand  the  above  information  and  have  discussed  this  information  with  the 
project's  staff  person.  I  agree  to  participate  voluntarily  in  this  study. 


Participant's  Signature  Date 
Project  Staff  Date 
ID#  /  

ConMiil  Form  -  WTO  Dieury  Auasmenl  Vilidauon  Study,  USDA  Ccnuut  «;3-]l98-2.032.  Fnonan.  SuUivu  A  Co.  (7^3) 
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Exit  Form 


PLEASE  PRINT 

ID# 

Name: 

first  middle 

last 

Child's  Name: 

(if  applicable)                   first  middle 

last 

Mailine  Address: 

Citv.  Zio: 

Teleohone:  (  ) 

Location: 

Study  Category: 

Telephone  Recalls  Completed: 

1 Q  Eligible  child  ( 1-4  years  only) 

□  3 

2Q  Pregnant 

□  2 

3Q  Postpartum,  breast-feeding  (0-12  months  onlv) 

□  1 

4Q  Postpartum,  not  breast-feedine  (0-6  months  onlv) 

Q  None 

Total  vears  of  school  completed:  Kircieone) 

12  3  4  5  6  7  8      9  10  11  12         13  14  15  16 

17+ 

mos. 

(elementary)                     (secondary)  (college) 

(graduate) 

(vocational  school) 

If  in  Pregnant  categorv.  still  pregnant? 

□  Yes 

□  No      □  N/A 

If  in  Postpartum  categorv: 

Breast-feeding  her  child? 

□  Yes 

□  No      □  N/A 

During  the  past  month,  breast-fed  her  child? 

□  Yes 

□  No      □  N/A 

Participant  on  WIC  anytime  during  the  past  4  weeks?      □Yes     □  No 

OK  to  contact  again  by  phone  if  we  have  questions  □  Yes  □  No 
about  the  food  surveys  or  the  recall  interviews? 

Any  complaints,  problems,  suggestions: 

Notes: 

/    Project  Staff: 

today's  dale 

Eill  Form  -  WIC  Dieuary  \,.«:N«t«rot  Validaiion  Study.  I  SDA  Contract  (í5?-3 198-2.032.  Freeirun.  Sullivan  &  Co.  (9/93) 
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APPENDIX  TABLES 

Table 

Validity  Coefficients 


Adjusted  Validity  Coefficients  for  Harvard  and  Block  FFQ-1  D-1 

Adjusted  Validity  Coefficients  for  Harvard  and  Block  FFQ-2  D-2 

Validity  Coefficients  Averaging  FFQ- 1  and  FFQ-2  D-3 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 
with  No  FFQs  Dropped  * 

Energy  (no  FFQs  dropped)  D-4 

Protein  (no  FFQs  dropped)  D-5 

Vitamin  A  (no  FFQs  dropped)  D-6 

Vitamin  C  (no  FFQs  dropped)  D-7 

Iron  (no  FFQs  dropped)  D-8 

Calcium  (no  FFQs  dropped)  D-9 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 
with  Outlier  FFQs  Dropped  * 

Energy  (outlier  FFQs  dropped)  D-10 

Protein  (outlier  FFQs  dropped)  D- 1 1 

Vitamin  A  (outlier  FFQs  dropped)  D-1 2 

Vitamin  C  (outlier  FFQs  dropped)  D- 1 3 

Iron  (outlier  FFQs  dropped)  D-1 4 

Calcium  (outlier  FFQs  dropped)  D-1 5 
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Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 
with  No  FFQs  Dropped  * 


Energy  (no  FFQs  dropped)  D-16 

Protein  (no  FFQs  dropped)  D-17 

Vitamin  A  (no  FFQs  dropped)  D-18 

Vitamin  C  (no  FFQs  dropped)  D- 1 9 

Iron  (no  FFQs  dropped)  D-20 

Calcium  (no  FFQs  dropped)  D-2 1 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 
with  Outlier  FFQs  Dropped  * 

Energy  (outlier  FFQs  dropped)  D-22 

Protein  (outlier  FFQs  dropped)  D-23 

Vitamin  A  (outlier  FFQs  dropped)  D-24 

Vitamin  C  (outlier  FFQs  dropped)  D-2  5 

Iron  (outlier  FFQs  dropped)  D-26 

Calcium  (outlier  FFQs  dropped)  D-2 7 


*  Interpreting p-values  in  Tables  D-4  to  D-27: 

A  p-value  of  <  0.05  indicates  that  the  FFQ  significantly  under-  or  over- 
estimates mean  nutrient  intake  when  compared  to  the  recall  data. 
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Table  D-1 

Adjusted  Validity  Coefficients  for  IHarvard  and  Block  FFQ-1 

All  Cases  Included 

Outliers  Dropped 

Harvard 

Block 

Harvard 

Block 

African  American 

Energy 

0.22 

0.63 

0.15 

044 

Protein 

0.26 

0.52 

0.09 

0.40 

Vitamin  A 

0.00 

0.34 

0.01 

0.16 

Vitamin  C 

-0.44 

0.39 

-0.28 

0.35 

Iron 

0.02 

0.47 

0.03 

0.23 

Calcium 

0.32 

0.51 

046 

0.44 

Hispanic 

Energy 

0.22 

0.15 

0.09 

0.08 

Protein 

0.15 

0.10 

0.12 

0.00 

Vitamin  A 

0.51 

0.19 

0.50 

0.31 

Vitamin  C 

0.32 

0.21 

020 

018 

Iron 

0.33 

-0.01 

-0.03 

-0.14 

Calcium 

0.20 

0.17 

0.15 

0.20 

White 

Energy 

0.31 

049 

0.33 

0.53 

Protein 

0.38 

0.59 

0.43 

0.62 

Vitamin  A 

0.35 

0.74 

0.37 

0.66 

Vitamin  C 

0.39 

0,24 

0.37 

0.16 

Iron 

0.32 

0.55 

0.37 

0.46 

Calcium 

0.44 

0.63 

0.48 

0.57 

All  Women 

Energy 

0.22 

0.42 

018 

0.34 

Protein 

0.28 

0.39 

0.25 

0.31 

Vitamin  A 

0.25 

0.39 

0.22 

0.31 

Vitamin  C 

0.15 

0.36 

0.15 

0.29 

Iron 

0.23 

0.30 

0.13 

0.14 

Calcium 

0.33 

0.47 

0.39 

040 

Pregnant 

Energy 

0.25 

0.33 

0.24 

024 

Protein 

0.34 

0.36 

0.28 

0.31 

Vitamin  A 

0.36 

0.31 

0.36 

0.23 

Vitamin  C 

0.15 

0.22 

0.10 

0.14 

Iron 

0.38 

0.05 

0.36 

-0.08 

Calcium 

0.46 

0.41 

0.53 

0.31 

Breastfeeding 

Energy 

0.26 

0.29 

0.14 

0.22 

Protein 

0.21 

0.27 

0.15 

0.12 

Vitamin  A 

0.30 

0.34 

0.31 

U.OO 

Vitamin  C 

0.06 

0.26 

0.03 

0.15 

Iron 

0.07 

0.33 

-0.31 

0.22 

Calcium 

0.20 

0.36 

0.28 

0.32 

Non-breastfeeding 

Energy 

0.16 

0.53 

0.16 

0.50 

Protein 

0.22 

0.50 

0.19 

0.41 

Vitamin  A 

0.10 

0.47 

0.00 

0.36 

Vitamin  C 

0.21 

0.47 

0.24 

0.49 

Iron 

0.24 

0.43 

0.24 

0.26 

Calcium 

0.26 

0.50 

0.21 

0.43 

Children 

Energy 

0.15 

0.16 

0.26 

0.11 

Protein 

0.23 

0.18 

0.37 

0.04 

Vitamin  A 

0.36 

0.04 

0.38 

0.08 

Vitamin  C 

0.12 

0.23 

0.23 

0.36 

Iron 

0.01 

0.19 

0.06 

0.24 

Calcium 

0.30 

0.04 

0.26 

0.04 
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Table  D-2 

Adjusted  Validity  Coefficients  for  Harvard  and  Block  FFQ-2 

All  Cases  Included 

Outliers  Dropped 

Han/a  rH 
nai  vai  u 

Block 

Block 

0.38 

0.49 

0.55 

0.53 

Protein 

0.24 

0.49 

0.39 

0.52 

Vitamin  A 

0.21 

0.20 

0.35 

0.09 

Vitamin  C 

0.13 

0.44 

0.18 

0  44 

Iron 

0.18 

0.50 

0.33 

0.54 

PalHiim 
wai^iui  1 1 

0.42 

0.52 

0.68 

0.60 

MícnAnÍP 
ni  Auai  11^ 

0.18 

0.15 

0.14 

0.07 

Protein 

0.17 

0.13 

0.16 

0.10 

Vitamin  A 

0.42 

0.09 

0.38 

0.03 

Vitamin  C 

0.39 

0.31 

0.35 

0.40 

Iron 

0.42 

0.05 

0.13 

0.08 

n  91 

V.^  1 

0,34 

0.18 

n  71 

w,^  1 

WhitA 

Willie 

energy 

0.41 

0,47 

0.46 

0,45 

r  1  UlCll  1 

0.37 

0,53 

0.41 

0,52 

Vitamin  A 

0.33 

0,73 

0.39 

0.62 

Vitamin  C 

0.51 

0.42 

0.59 

0.29 

Iron 

0.29 

0.60 

0.31 

0.59 

0.50 

0.57 

0.60 

0.48 

All  lAlnmpn 

iciyy 

0,27 

0.35 

0.37 

0.35 

Prntpin 

0,25 

0.37 

0.34 

0,38 

Vitamin  A 

0.29 

0.28 

0.32 

0.20 

Vitamin  C 

0.38 

0.43 

0.38 

0.42 

Iron 

0,29 

0,34 

0.25 

0,38 

^^aiuui  1 1 

0,37 

0,50 

0.54 

0,46 

Preanant 

0,22 

0,26 

0.51 

0,38 

Prntpin 

0,26 

0,35 

0.45 

0,47 

Vitamin  A 

0,20 

0,29 

0.30 

0,41 

Vitamin  C 

0,40 

0,22 

0.39 

0,33 

Iron 

0,21 

0,21 

0.34 

0,42 

walWIUlI  1 

0.25 

0.39 

0.48 

0,41 

B  r6d  stf Gcd  j  n  9 

Pnprnv 

0.35 

0,34 

0.39 

0,38 

Protein 

0.24 

0.27 

0.37 

0,33 

Vitamin  A 

0.34 

0.32 

0.31 

0.21 

Vitamin  C 

0.33 

0.48 

0.43 

0.45 

Iron 

0,33 

0.45 

0.08 

0.51 

Calcium 

0,39 

0,39 

0.56 

0,32 

Non  4)reastfeedin9 

Pnprnv 

0  16 

0.37 

0.19 

0,27 

r  1  wlCII  1 

0.19 

0.44 

0.13 

0,36 

Vitamin  A 

0,22 

0.20 

0.23 

-0.06 

Vitamin  C 

0.30 

0,50 

0.19 

0.44 

Iron 

0,27 

0,31 

0.22 

0.17 

Calcium 

0.39 

0,56 

0.40 

0,52 

Children 

Energy 

0,17 

0,38 

0.32 

0.35 

Protein 

0,26 

0.31 

0.42 

0.17 

Vitamin  A 

0,37 

0,10 

0.27 

0.11 

Vitamin  C 

0.22 

0.27 

0.24 

0.40 

Iron 

0,10 

0.32 

0.20 

0.47 

Calcium 

0,32 

0.23 

0.31 

0,23 
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Table  D-3 

Validity  Coefficients  Averaging  FFQ-1  and  FFQ-2 

All  Cases  Included 

Outliers  Dropped 

narvara 

DiOCK 

riarvard 

African  American 

Energy 

0.27 

0.51 

0.26 

0.50 

Protein 

0.21 

0.49 

0.18 

0.46 

Vitamin  A 

n  rv? 

0.14 

Vitamin  C 

n  I'i 

-U.  1  o 

n  "^7 

.n  04 

0.42 

Iron 

n  c\R 

n  14 

0  44 

Calcium 

U.D  1 

n  44 

Hispanic 

Energy 

0.18 

0.13 

0.18 

0.20 

Protein 

0.14 

0.10 

0.16 

0.18 

Vitamin  A 

0  41 

0  14 

Vitamin  C 

U-0*T 

n  94 

n  90 

0.32 

Iron 

u.oo 

0.09 

0.09 

Calcium 

n  iR 

U.  1  o 

n  99 

n  iQ 

n  9Q 

wniie 

Energy 

0.34 

0.43 

0.34 

0.45 

Protein 

0.38 

0.51 

0.38 

0.54 

Vitamin  A 

0.37 

0.65 

0.37 

0.65 

Vitamin  C 

n  47 

W.*tf 

n  9Q 

0  44 

0.29 

M  Ul  1 

n  Tí 

Calctum 

V,tJ\J 

All  Women 

energy 

0.23 

0.37 

0.26 

0.39 

"roiein 

0.24 

0.36 

0.26 

0.39 

Vitamin  A 

0.22 

0.29 

0.25 

0.29 

Vitamin  C 

0.36 

0.28 

0.40 

Iron 

n  9Q 

0  'Í9 

9 1     1 1  nn 

LrolCIUm 

n  4A 

0.43 

0.47 

r  Icynalll 

energy 

0.23 

0.28 

0.31 

0.39 

r  roiein 

0.27 

0.35 

0.33 

0.43 

Vitamin  A 

0.26 

0.25 

0.33 

0.31 

Vitamin  C 

0.28 

0.20 

0.25 

0.28 

Iron 

n  1 1 

n  94 

^sl^ii  inn 

0.35 

0.40 

0.47 

0.44 

R  r  cff AAfI  i  n  fi 

energy 

0.30 

0.29 

0.24 

0.30 

"roiein 

0.21 

0.24 

0.23 

0.25 

Vitamin  A 

0.24 

0.26 

0.23 

0.17 

Vitamin  C 

0  94 

0.38 

Iron 

0.17 

0.34 

-0.13 

0.38 

0.32 

0.35 

0.39 

0.32 

KInn  Jiroacff AAHinci 
iwii^f  icaotimfuiliu 

energy 

0.14 

0.45 

0.15 

0.42 

r  lUlCin 

0.17 

0.44 

0.16 

0.42 

Vitamin  A 

0.11 

0.30 

0.05 

0.27 

V/itamin 
viiaiiiiii  w 

0.17 

0.42 

0.16 

0.43 

Iron 

0.22 

0.34 

0.23 

0.32 

Calcium 

0.27 

0.49 

0.27 

0.52 

Children 

Energy 

0.14 

0.24 

0.27 

0.27 

Protein 

0.21 

0.22 

0.32 

0.23 

Vitamin  A 

0.29 

0.07 

0.26 

0.07 

Vitamin  C 

0.16 

0.23 

0.22 

0.34 

Iron 

0.04 

0.21 

0.10 

0.22 

Calcium 

0.32 

0.14 

0.35 

0.10 
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Table  D-4 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 
No  FFQs  dropped 


Energy  (kcal) 

Harvard 


Block 


Recalls 

FFQ-1 

Recalls 

FFQ-1 

All  Wnmpn 

It  I^KIIOI  1 

1,897 

2,167 

1,905 

1,823 

mean 

1,994 

2,685 

1,994 

2,034 

SD 

607 

2,040 

635 

1.262 

n 

235 

235 

234 

234 

P 

<0.01 

0.62 

African  Ampririin 

mnHio  n 

2,164 

2,246 

2,147 

1,998 

mean 

2.211 

2,747 

2,176 

2,137 

SD 

671 

1,900 

670 

1,276 

n 

81 

81 

82 

82 

P 

<0.05 

0.75 

Hisnanir 

ft  IVlJIOi  1 

1,780 

2,554 

1,848 

1,786 

mean 

1,810 

3.220 

1,909 

2,161 

SD 

482 

2,538 

570 

1,550 

n 

71 

71 

84 

84 

P 

<0.01 

0.15 

White 

maHian 

1,865 

1,931 

1,740 

1,689 

mean 

1,941 

2,169 

1,878 

1,752 

SD 

579 

1.528 

628 

690 

n 

83 

83 

68 

68 

P 

0.18 

0.13 

Preanant 

msdisn 

1 1  fwWf  Of  1 

1,965 

2,022 

2,046 

1,867 

mean 

2,115 

2.528 

2.122 

1.997 

SD 

592 

1.716 

631 

836 

n 

75 

75 

81 

81 

P 

<0.05 

0.21 

Breastfeeding 

median 

1,983 

2,211 

1,917 

1,929 

mean 

2,056 

2,865 

2.013 

2.066 

SD 

583 

2,340 

606 

888 

n 

81 

81 

74 

74 

P 

<0.01 

0.63 

Non-breastfeeding 

median 

1,634 

2,155 

1,698 

1,606 

mean 

1,816 

2,651 

1.844 

2.042 

SD 

611 

2,005 

642 

1,816 

n 

79 

79 

79 

79 

P 

<0.01 

0.29 

Children 

median 

1,179 

1,730 

1,350 

1,323 

mean 

1.259 

2,043 

1.344 

1,449 

SD 

397 

1,630 

374 

695 

n 

94 

94 

87 

87 

P 

<0.01 

0.20 
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Table  D-5 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

No  FFQs  dropped 

Protein  (g) 

Harvard 

Block 

Recalls  FFQ-1 

Recalls  FFQ-1 

All  Women 

median 

78.4 

76.8 

76.8  79.1 

mean 

79.6 

97.0 

79.6  90.2 

SD 

25.5 

77.3 

27.5  61.8 

n 

235 

235 

234  234 

P 

<0.01 

<0.01 

African  American 

median 

85.4 

79.1 

84.4  79.9 

mean 

86.0 

101.6 

83.2  94.9 

SD 

27.0 

74.7 

27.9  59.0 

n 

81 

81 

82  82 

P 

0.06 

0.05 

Hispanic 

median 

76.2 

88.8 

74.4  74.3 

mean 

76.3 

116.6 

79.6  94.9 

SD 

21.7 

99.8 

27.2  80.0 

n 

71 

71 

84  84 

P 

<0.01 

0.09 

V  A  /Ilk 

White 

median 

71.9 

66.9 

72.1  79.5 

mean 

76.0 

75.8 

75.3  78.8 

CO 

26.0 

48.0 

27.0  31.0 

n 

83 

83 

68  68 

P 

0.97 

0.31 

Pregnant 

median 

80.3 

76.0 

86.0  87.1 

mean 

82.8 

93.4 

86.3  86.7 

SD 

27.2 

69.7 

28.4  38.4 

n 

75 

75 

81  81 

P 

0.18 

0.93 

Breastfeeding 

median 

81.6 

83.6 

73.4  84.3 

mean 

83.1 

104.1 

79.3  93.0 

SD 

23.7 

89.5 

25.9  39.0 

n 

81 

81 

74  74 

P 

<0.05 

<0.01 

Non-breastfeeding 

median 

69.3 

73.1 

70.6  70.3 

mean 

72.9 

93.2 

73.1  91.3 

SD 

24.5 

70.9 

26.7  91.9 

n 

79 

79 

79  79 

P 

<0.05 

0.07 

Children 

median 

47.4 

60.5 

50.8  59.2 

mean 

47.5 

71.7 

52.0  67.0 

SD 

13.9 

48.6 

14.5  34.4 

n 

94 

94 

87  87 

P 

<0.01 

<0.01 
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Table  D-6 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

No  FFQs  dropped 

Vitamin  A  (RE) 

Harvard 

Block 

Recalls  FFQ-1 

Recalls  FFQ-1 

All  Women 

median 

763 

1,597 

779  1,232 

mean 

882 

2,504 

896        1 .544 

SD 

499 

5,134 

505  2.253 

n 

235 

235 

234  234 

P 

<0.01 

<0.01 

African  Annehcan 

median 

703 

1,514 

803  1,236 

mean 

835 

2,118 

887  1,539 

SD 

473 

2,224 

526  2,063 

n 

81 

81 

82  82 

P 

<0.01 

<0.01 

Hispanic 

median 

791 

2,559 

691  1,229 

mean 

895 

4,262 

867        1 ,81 1 

SD 

540 

8.763 

506  3,099 

n 

71 

71 

84  84 

P 

<0.01 

<0.01 

White 

median 

814 

1,279 

827  1,174 

mean 

918 

1,378 

943  1,219 

SD 

490 

855 

482  646 

n 

83 

83 

68  68 

P 

<0.01 

<0.01 

Pregnant 

median 

814 

1,507 

814  1,236 

mean 

945 

2,054 

971  1,321 

SD 

516 

2,033 

543  713 

n 

75 

75 

81  81 

P 

<0.01 

<0.01 

Breastfeeding 

median 

843 

1,756 

819  1,559 

mean 

947 

3,271 

936        1 ,630 

SD 

490 

8,074 

489  814 

n 

81 

81 

74  74 

P 

<0.05 

<0.01 

Non-breastfeeding 

median 

629 

1,576 

709  867 

mean 

756 

2,146 

781  1,691 

SD 

475 

2,713 

465  3.734 

n 

79 

79 

79  79 

P 

<0.01 

<0.05 

Children 

median 

561 

897 

557  818 

mean 

636 

1,239 

600  996 

SD 

302 

1.021 

266  585 

n 

94 

94 

87  87 

P 

<0.01 

<0.01 
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Table  D-7 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

No  FFQs  dropped 

Vitamin  C  (mg) 

Harvard 

Block 

Recalls  FFQ-1 

Recalls  FFQ-1 

All  Women 

median 

114 

145 

97 

109 

mean 

125 

199 

117 

130 

SD 

78 

168 

69 

101 

n 

235 

235 

234 

234 

P 

<0.01 

0.07 

African  American 

median 

142 

148 

86 

104 

mean 

145 

199 

109 

125 

SD 

78 

161 

68 

110 

n 

81 

81 

82 

82 

P 

<0.05 

0.22 

Hispanic 

median 

121 

209 

132 

130 

mean 

137 

252 

141 

159 

SD 

85 

184 

69 

112 

n 

71 

71 

84 

84 

P 

<0.01 

0.20 

White 

median 

77 

111 

76 

88 

mean 

97 

154 

97 

100 

SD 

65 

149 

62 

60 

n 

83 

83 

68 

68 

P 

<0.01 

0.73 

Pregnant 

median 

122 

164 

110 

116 

mean 

134 

202 

127 

129 

SD 

77 

155 

71 

78 

n 

75 

75 

81 

81 

P 

<0.01 

0.86 

Breastfeeding 

median 

131 

157 

116 

110 

mean 

137 

219 

126 

137 

SD 

80 

191 

69 

83 

n 

81 

81 

74 

74 

P 

<0.01 

0.36 

Non-breastfeeding 

median 

82 

133 

77 

89 

mean 

105 

176 

98 

125 

SD 

75 

154 

64 

133 

n 

79 

79 

79 

79 

P 

<0.01 

0.08 

Children 

median 

62 

99 

77 

79 

mean 

76 

137 

81 

94 

SD 

44 

121 

40 

62 

n 

94 

94 

87 

87 

P 

<0.01 

0.09 
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Table  D-8 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

No  FFQs  dropped 

Iron  (mg) 

Harvard 

Block 

Recalls 

FFQ-1 

Recalls  FFQ-1 

All  Women 

med/an 

14.2 

10.8 

13.6  10.8 

mean 

14.5 

14.5 

14.3  11.6 

SD 

5.2 

12.0 

5.5  8.3 

n 

235 

235 

234  234 

P 

0.99 

<0.01 

African  American 

median 

15.2 

11.2 

13.9  11.1 

mean 

15.5 

14.4 

15.0  11.9 

SD 

5.2 

10.7 

5.9  81 

n 

81 

81 

82  82 

P 

0.38 

<0.01 

Hispanic 

median 

13.2 

14.3 

13.5  11.4 

mean 

14.3 

19.3 

13.9  13.4 

SD 

5.1 

15.6 

5.4  10.6 

n 

71 

71 

84  84 

P 

<0.01 

0.72 

White 

median 

12.7 

9.4 

13.1  9.3 

mean 

13.5 

10.4 

13.9  9.2 

SD 

5.0 

7.3 

5.2  3.6 

n 

83 

83 

68  68 

P 

<0.01 

<0.01 

Pregnant 

median 

14.2 

10.7 

14.4  11.2 

mean 

15.6 

13.7 

15.1  11.1 

SD 

5.6 

10.5 

5.6  4.6 

n 

75 

75 

81  81 

P 

0.12 

<0.01 

Breastfeeding 

median 

14.5 

11.8 

14.1  11.2 

mean 

14.5 

15.5 

15.0  12.0 

SD 

4.3 

14.3 

5.7  4.9 

n 

81 

81 

74  74 

P 

0.50 

<0.01 

Non-breastfeeding 

median 

12.3 

10.8 

11.3  9.8 

mean 

13.3 

14.1 

12.8  11.9 

SD 

5.3 

10.8 

5.1  12.7 

n 

79 

79 

79  79 

P 

0.54 

0.53 

Children 

median 

9.7 

9.3 

9.6  6.4 

mean 

10.2 

11.2 

10.3  8.0 

SD 

3.4 

8.7 

3.7  4.5 

n 

94 

94 

87  87 

P 

0.27 

<0.01 
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Table  D-9 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

No  FFQs  dropped 

Calcium  (mg) 

Harvard 

Block 

Recalls 

FFQ-1 

Recalls  FFQ-1 

All  women 

median 

842 

1,172 

834  1,031 

mean 

876 

1,319 

893        1 ,289 

SD 

382 

888 

400  908 

n 

235 

235 

234  234 

P 

<0.01 

<0.01 

African  American 

median 

758 

1,187 

111  945 

mean 

800 

1,316 

799        1 ,263 

SD 

365 

803 

376  889 

n 

81 

81 

82  82 

P 

<0.01 

<U.U1 

nispanic 

median 

874 

1,292 

mean 

892 

1,464 

891  1,300 

SD 

339 

999 

355         1 ,051 

n 

71 

71 

84  84 

P 

<0.01 

<0.01 

wniie 

median 

852 

1,047 

1,010  1,243 

mean 

935 

1,197 

1,009  1,307 

SD 

424 

857 

452  735 

n 

83 

83 

68  68 

P 

<0.01 

<0.01 

"regnant 

median 

886 

1,199 

4  AO'S           4  oce 

1,023  1,265 

mean 

953 

1,289 

1,030  1,353 

SD 

418 

756 

439  798 

n 

75 

75 

81  81 

P 

<0.01 

<0.01 

Dl  CaaUccQiny 

median 

897 

1,292 

865  1,174 

mean 

942 

1,488 

915  1,427 

SD 

365 

954 

353  794 

n 

81 

81 

74  74 

P 

<0.01 

<U.U1 

iNon-Dicasuecainy 

median 

713 

908 

09Q  o91 

mean 

734 

1,173 

733        1 ,093 

SD 

326 

915 

342          1 ,075 

n 

79 

79 

79  79 

P 

<0.01 

<0.01 

Children 

median 

627 

858 

715  1,021 

mean 

682 

1,011 

756        1 ,082 

SD 

263 

638 

272  614 

n 

94 

94 

87  87 

P 

<0.01 

<0.01 
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Table  D-10 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

Outlier  FFQs  Dropped 

Energy  (kcal) 

Harvard 

Block 

Recalls 

FFQ-1 

Recalls  FFQ-1 

All  \  it  /  _  

All  Women 

median 

1,839 

1,985 

1,957  1,893 

mean 

1,961 

2,058 

2,012  2,014 

SD 

593 

919 

636  806 

f¡ 

204 

204 

208  208 

P 

0.17 

0.97 

African  Annerican 

median 

2,105 

2,109 

2,219  2,074 

mean 

2,160 

2,172 

2,213  2,155 

SD 

653 

999 

631  860 

n 

70 

70 

71  71 

P 

0.92 

0.58 

Hispanic 

median 

1,662 

2,184 

1,848  1,786 

mean 

1,752 

2,243 

1,910  1,984 

SD 

436 

913 

575  866 

n 

57 

57 

78  78 

P 

<0.01 

0.51 

White 

median 

1,815 

1,728 

1,763  1,812 

mean 

1,935 

1,817 

1,904  1,884 

SD 

585 

798 

668  625 

n 

77 

77 

59  59 

P 

0.23 

0.82 

Pregnant 

median 

1,949 

1,967 

2,103  1,929 

mean 

2,094 

2,015 

2,159  2,102 

SD 

594 

950 

624  791 

n 

66 

66 

74  74 

P 

0.53 

0.58 

Breastfeeding 

median 

1,897 

2,166 

1,925  1,929 

mean 

1,984 

2,152 

2,002  1,975 

SD 

525 

902 

603  684 

n 

70 

70 

69  69 

P 

0.16 

0.79 

Non-breastfeeding 

median 

1,594 

1,885 

1,711  1,727 

mean 

1,808 

2,002 

1,854  1,956 

SD 

630 

911 

652  938 

n 

68 

68 

65  65 

P 

0.13 

0.37 

Children 

median 

1,219 

1,574 

1,396  1,323 

mean 

1,267 

1,600 

1.359  1,417 

SD 

409 

585 

378  546 

n 

82 

82 

81  81 

P 

<0.01 

0.42 
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Table  D-11 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

Outlier  FFQs  Dropped 

Protein  (g) 

Harvard 

Recalls 

PFQ-1 

Recalls  FFQ-1 

All  Women 

mediBP 

72.4 

78.0  81.1 

mean 

78.5 

74.3 

80.4  89.0 

SD 

25.3 

34.0 

27.5  37.5 

n 

204 

204 

208  208 

P 

0.13 

<0.01 

African  American 

mediBP 

81.5 

75.1 

84.4  86.7 

mean 

83.8 

80,1 

84.5  95.9 

SD 

26.5 

40.1 

27.1  42.0 

n 

70 

70 

71  71 

P 

0.51 

<0.05 

Hispanic 

median 

74.5 

77.9 

74.4  74.3 

mean 

74.9 

78.9 

79.4  85.9 

SD 

21.4 

28.1 

27.2  39.1 

n 

57 

57 

78  78 

P 

0.37 

0.23 

White 

median 

76.2 

63.6 

73.6  87.8 

mean 

76.3 

65.6 

76.8  84.7 

SD 

26.4 

30.4 

28.3  27.9 

n 

77 

77 

59  59 

P 

<0,01 

<0.05 

Pregnant 

median 

75.9 

72.6 

88.9  91.2 

mean 

81.8 

72.6 

88.1  91.3 

SD 

27.2 

28.5  36.8 

n 

66 

66 

74  74 

P 

0.06 

0.49 

Breastfeeding 

median 

80.3 

75.7 

74.2  83.9 

mean 

81.3 

79.9 

78.3  89.5 

SD 

22.7 

33.9 

25.2  32.1 

n 

70 

70 

69  69 

P 

0.76 

<0.05 

Non-breastfeeding 

median 

68.6 

67.7 

71.4  71.8 

mean 

72.3 

70.1 

73.8  85.8 

SD 

25.2 

32.7 

27.0  43.6 

n 

68 

68 

65  65 

P 

0.66 

<0.05 

Children 

median 

48.2 

56.4 

52.0  59.2 

mean 

47.8 

58.1 

52.5  65.5 

SD 

14.5 

22.7 

14.5  26.7 

n 

82 

82 

81  81 

P 

<0.01 

<0.01 
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Table  D- 

12 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

Outlier  FFQs  Dropped 

Vitamin  A 

(RE) 

Harvard 

Block 

Recalls  FFQ-1 

Recalls  FFQ-1 

All  Women 

median 

763 

1,435 

803 

1,270 

mean 

877 

1,672 

909 

1,421 

SO 

496 

1,119 

496 

794 

n 

204 

204 

208 

208 

P 

<0.01 

<0.01 

African  American 

median 

754 

1,395 

798 

1,340 

mean 

865 

1,668 

872 

1,423 

SD 

494 

1,158 

482 

771 

n 

70 

70 

71 

71 

P 

<0.01 

<0.01 

Hispanic 

median 

746 

2,090 

700 

1,229 

mean 

824 

2,246 

883 

1,484 

SD 

509 

1,256 

518 

933 

n 

57 

57 

78 

78 

p 

<0.01 

<0.01 

White 

median 

814 

1,227 

882 

1,292 

mean 

928 

1,251 

990 

1,335 

SD 

491 

730 

484 

603 

n 

77 

77 

59 

59 

P 

<0.01 

<0.01 

Pregnant 

median 

781 

1,303 

862 

1,324 

mean 

939 

1,619 

1 ,007       1 ,396 

SD 

514 

1,159 

549 

698 

n 

66 

66 

74 

74 

P 

<0.01 

<0.01 

Breastfeeding 

median 

807 

1,623 

782 

1,552 

mean 

922 

1,801 

932 

1,607 

SD 

483 

1,035 

489 

765 

n 

70 

70 

69 

69 

P 

<001 

<0.01 

Non-breastfeeding 

median 

652 

1,332 

709 

925 

mean 

771 

1,591 

775 

1,252 

SD 

482 

1,165 

413 

891 

n 

68 

68 

65 

65 

P 

<0.01 

<0.01 

Children 

median 

537 

805 

557 

818 

mean 

618 

970 

596 

955 

SD 

300 

591 

266 

500 

n 

82 

82 

81 

81 

P 

<0.01 

<0.01 
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Table  D-13 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

Outlier  FFQs  Dropped 

Vitamin  C  (mg) 

Harvard 

Block 

Recalls  FFQ-1 

Recalls  FFQ-1 

All  Women 

It  txfxJiOl  1 

113 

124 

104 

111 

m&Qn 

125 

164 

120 

128 

on 

79 

121 

ru 

7ft 
/  O 

n 

208 

208 

p 

0.24 

MTriCan  Mmerican 

148 

132 

88 

109 

rn&Qfi 

153 

168 

115 

124 

70 

1 1Q 

71 

81 

n 

70 

70 

71 

71 

p 

0.42 

0.42 

niopcir  lie 

101 

187 

133 

130 

moon 

128 

206 

141 

148 

OA 

/I 

57 

57 

78 

78 

p 

<0.01 

0.59 

WhitP 

VVi  lUc 

fftVXJtai  1 

73 

104 

83 

99 

moon 

96 

130 

100 

107 

SO 

WW 

65 

103 

64 

57 

/I 

77 

77 

59 

59 

p 

<0.01 

0.49 

1  1  c^i  lai  11 

rn&disn 

121 

137 

116 

124 

mosn 

130 

171 

131 

136 

SD 

/  Z 

11Q 

1  1 9 

79 

77 

n 

66 

66 

74 

74 

p 

<0.05 

0.70 

122 

127 

117 

110 

137 

178 

125 

131 

SD 

83 

134 

68 

73 

n 

70 

70 

69 

69 

p 

<0.05 

0.60 

Nnn-Krp^Qtfpprlinn 

median 

80 

120 

85 

92 

mean 

106 

143 

103 

116 

SD 

78 

106 

68 

83 

n 

68 

68 

65 

65 

P 

<0.05 

0.24 

Children 

median 

63 

81 

76 

78 

mean 

77 

109 

81 

88 

SD 

45 

76 

40 

52 

n 

82 

82 

81 

81 

P 

<0.01 

0.29 
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Table  D-14 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

Outlier  FFQs  Dropped 

Iron  (mg) 

Harvard 

Block 

P  VJ-  1 

r\GCaiiS  rrU-l 

All  \A/ompn 

median 

1  0.9 

in  9 

9 A  O  111 
^4.U  11.1 

mean 

14.2 

10.9 

14.5  11.5 

SD 

5.1 

5.2 

5.5  4.3 

n 

204 

204 

D 

<n  ni 

African  Ampripan 

median 

1  S.^v 

in  ft 

1A  A            11  ^ 
14.U            11.  J 

mean 

15.6 

11.3 

15.2  11.9 

SD 

5.4 

5.5 

5.6  4.8 

n 

m 

fU 

7rt 
/O 

71  71 

o 
r 

^U.U  1 

median 

12  A 

12  7 

lO.O  11.4 

mean 

13.3 

13.2 

14.0  12.3 

SD 

4.7 

5.1 

5.6  4.5 

n 

Or 

78  78 

p 

n  Q9 

White 

median 

13  7 

1            10  1 

mean 

13.6 

8.8 

14.4  10.0 

SD 

5.0 

4.0 

5.3  3.1 

n 

T7 

f  Í 

o 

Pr^nnant 

median 

1A  0 

10  2 

1A  4           11  ^ 

mean 

15.4 

10.5 

15.3  11.7 

SD 

5.8 

5.5 

5.6  4.3 

n 

74  74 

o 

Rrpa^tf  ppH  inn 

median 

1A  3 

10  ñ 

14 1  111 

mean 

14.0 

11.3 

15.0  11.5 

SD 

4.3 

5.0 

5.5  3.7 

n 

70 

70 

69  69 

D 
r 

<0.01 

Nlnn*hrPS^tfppHinn 

median 

12.3 

9.9 

19  1          10  5 

mean 

13.3 

10.8 

13.1  11.2 

SD 

5.0 

5.1 

n 

68 

68 

65  65 

P 

<0.01 

<0.05 

Children 

median 

10.0 

8.5 

9.8  6.4 

mean 

10.2 

8.7 

10.3  7.8 

SD 

3.5 

3.3 

3.6  3.7 

n 

82 

82 

81  81 

P 

<0.01 

<0.01 
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Table  D-15 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-1  Estimates 

Outlier  FFQs  Dropped 

Calcium  (mg) 

Harvard 

Block 

Recalls 

FFQ-1 

All  \n/^inn^n 

All  vvomen 

maulan 

823 

1,061 

847          1  053 

moon 

0D4 

1,082 

910  1,292 

SD 

Of  9 

556 

397  792 

n 

204 

P 

<0.01 

MTrican  Mmerican 

762 

1,069 

m98n 

7Qfi 

1,110 

823  1,305 

SD 

Of  9 

548 

362  806 

n 

f  u 

70 

Tí  TI 
f  1                          f  1 

P 

<0.01 

l-J  ier\o  n  1^ 

niopdiiiu 

869 

1,150 

moQn 

oou 

1,115 

899  1.195 

CO 

502 

359  842 

n 

Of 

57 

7ft  7ft 
/  O                   f  o 

P 

<0.01 

VV 1 IIIC 

847 

983 

1  093         1  2AQ 

fTi&sn 

1,031 

1,029  1,403 

602 

457  700 

n 

77 
/  f 

77 

P 

0.12 

1   1  CUi  Idl  11 

890 

1,103 

1  OdO        1  411 

m&sn 

1,115 

1,074  1,427 

581 

427  785 

n 

AA 
OO 

66 

f  *»                     f  *♦ 

P 

<0.05 

^U.U  1 

Di  cdoLi  ecu  II  ly 

f  1  IO\JIOI  1 

870 

1,214 

ftfft          1  OQA 

tn&sn 

929 

1,218 

901         1 ,390 

373 

492 

345  767 

n 

70 

70 

69  69 

P 

<0.01 

Mrtri-hrAaQtfppHinn 
inlii  I'UI  Cdoiiccuii  ly 

median 

683 

738 

mean 

719 

909 

733        1 ,034 

SD 

328 

556 

^"V?  777 
OOO  III 

n 

68 

68 

65  65 

P 

<0.05 

<0.01 

Children 

median 

622 

809 

704  1,074 

mean 

668 

852 

747        1 ,066 

SD 

255 

381 

275  507 

n 

82 

82 

81  81 

P 

<0.01 

<0.01 

WIC  Dietary  Assessment  Validation  Study 
Final  Report  -  September  22,  1994 
Appendix  D 


Table  D-16 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

No  FFQs  Dropped 

Energy  (kcal) 

Harvard 

Block 

Recalls 

FFQ-2 

Recalls  FFQ-2 

All  Women 

median 

1,897 

1,834 

1,905  1,518 

mean 

1,994 

2,255 

1,994  1,730 

SD 

607 

1,898 

635           1 ,047 

n 

235 

235 

234  234 

P 

<0.05 

<0.01 

African  American 

median 

2,164 

1,956 

2,147  1,503 

mean 

2,211 

2,320 

2,176  1,764 

SD 

671 

1.821 

670  1,069 

n 

81 

81 

82  82 

P 

0.58 

<0.01 

Hispanic 

median 

1,780 

2,094 

1,848  1,595 

mean 

1,810 

2,848 

1.909  1,822 

SD 

482 

2,579 

570           1 ,260 

n 

71 

71 

84  84 

P 

<0.01 

0.56 

White 

median 

1,865 

1,596 

1,740  1,474 

mean 

1,941 

1.685 

1.878  1,576 

SD 

579 

852 

628  657 

n 

83 

83 

68  68 

P 

<0.01 

<0.01 

Pregnant 

median 

1,965 

1,978 

2,046  1,612 

mean 

2.115 

2.360 

2.122  1,758 

SD 

592 

1,712 

631  882 

n 

75 

75 

81  81 

P 

0.24 

<0.01 

Breastfeeding 

median 

1,983 

1,886 

1,917  1,691 

mean 

2,056 

2,455 

2,013  1,867 

SD 

583 

2,291 

606  1,003 

n 

81 

81 

74  74 

p 

0.11 

0.22 

Non-breastfeeding 

median 

1,634 

1,565 

1.698  1,255 

mean 

1,816 

1,950 

1,844  1,574 

SD 

611 

1,578 

642  1,222 

n 

79 

79 

79  79 

P 

0.47 

0.06 

Children 

median 

1,179 

1,437 

1,350  1,166 

mean 

1,259 

1,704 

1,344  1,304 

SD 

397 

1,105 

374  559 

n 

94 

94 

87  87 

P 

<0.01 

0.52 
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Table  D-17 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

No  FFQs  Dropped 

Protein  (g) 

Harvard 

Block 

Recalls 

FFQ-2 

Recalls  FFQ-2 

All  Women 

median 

78.4 

65.6 

76.8  69.1 

mean 

79.6 

81.3 

79.6  77.5 

SD 

25.5 

71.6 

27.5  51.7 

n 

235 

235 

234  234 

P 

0.71 

0.54 

African  American 

median 

85.4 

65.6 

84.4  74.4 

mean 

86.0 

85.6 

83  1         81  0 

SD 

27.0 

77.7 

27.9  50.3 

n 

81 

81 

82  82 

P 

0.96 

0.68 

Hispanic 

median 

76.2 

74.4 

74.4  67.7 

mean 

76.3 

100.9 

79.6  80.1 

SD 

21.7 

91  1 

27.2  64.5 

n 

71 

71 

84  84 

P 

<0.05 

0.95 

White 

median 

71.9 

57.1 

72.1  67.8 

mean 

76.0 

60.4 

75  3         70  0 

SD 

26.0 

29.5 

27.0  31.6 

n 

83 

83 

68  68 

P 

<0.01 

0.15 

Pregnant 

median 

80.3 

67.4 

86.0  70.6 

mean 

82.8 

82.3 

86  3         76  a 

SD 

27.1 

54.5 

28.4  42.2 

n 

75 

75 

81  81 

P 

0.95 

0.06 

Breastfeeding 

median 

81.6 

69.5 

73.4  73.2 

mean 

83  1 

91.1 

79.3  84.6 

SD 

23.7 

91.6 

25.9  45.0 

n 

81 

81 

74  74 

P 

0.43 

0.33 

Non-breastfeeding 

median 

69.3 

56.2 

70.6  57.4 

mean 

72.9 

70.3 

73.1  71.4 

SD 

24.5 

61.1 

26.7  64.6 

n 

79 

79 

79  79 

P 

0.72 

0.82 

Children 

median 

47.4 

51.8 

50.8  55.2 

mean 

47.5 

62.0 

52.0  59.4 

SD 

13.9 

38.2 

14.5  27.0 

n 

94 

94 

87  87 

P 

<0.01 

<0.05 
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Table  D-18 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

No  FFQs  Dropped 

Vitamin  A  (RE) 

Harvard 

Block 

Recalls 

FFQ-2 

KcCails  rrw-Z 

Mil  vvorncn 

m6di3n 

763 

1,251 

moan 

882 

2,111 

896        1 ,405 

SD 

499 

3,670 

505           1 ,657 

n 

235 

235 

234  234 

P 

<0.01 

<u.Ln 

/ATrican  Mmerican 

ITtQQIBn 

703 

1,211 

1  ñAR 

mean 

o-io 

1,715 

887  1,364 

SD 

473 

1,865 

526           1 ,329 

n 

81 

81 

82  82 

P 

<0.01 

nispanic 

mouisn 

791 

1,945 

D9 1               9  11 

m&on 

oyo 

3,715 

867        1 ,606 

SD 

540 

6,023 

506  2,305 

n 

/I 

71 

QA  ÜA 

P 

<0.01 

Whitp 

f  1  lOUlOl  1 

814 

1,033 

OA  /                     (  & 

tnosn 

Q1 

1,126 

943  1,207 

SD 

Aon 
49U 

846 

482  860 

n 

So 

83 

68  68 

P 

0.05 

r  1  eyndni 

mooiaii 

814 

1,404 

maan 

y4o 

1,934 

971        1 ,408 

SD 

DID 

1.853 

543  1,557 

n 

75 

75 

O  1  Ol 

P 

<0.01 

□  reasiiceuiny 

1 1  IVfJIOl  1 

843 

1,438 

mean 

947 

2,581 

936  1,506 

SD 

490 

5,001 

489  992 

n 

81 

81 

TA                         7  A 

74  í4 

P 

<0.01 

<0  01 

median 

629 

870 

709  802 

mean 

756 

1,797 

781        1 ,308 

SD 

475 

3.339 

n 

79 

79 

79  79 

P 

<0.01 

<0.05 

Children 

median 

561 

813 

557  815 

mean 

636 

1,097 

600  887 

SD 

302 

921 

266  440 

n 

94 

94 

87  87 

P 

<0.01 

<0.01 
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TableD-19 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

No  FFQs  Dropped 

Vitamin  C  (mg) 

Harvard 

Block 

Recalls  FFQ-2 

Recalls  FFQ-2 

All  Women 

median 

114 

105 

97 

90 

mean 

125 

151 

117 

107 

SD 

78 

135 

69 

80 

n 

235 

235 

234 

234 

p 

<0.01 

0.09 

African  Amencan 

median 

142 

116 

86 

89 

mean 

145 

158 

109 

99 

SD 

78 

124 

68 

62 

n 

81 

81 

82 

82 

p 

0.42 

0.27 

Hispanic 

median 

121 

135 

132 

100 

mean 

137 

199 

141 

131 

SD 

85 

177 

69 

104 

n 

71 

71 

84 

84 

o 

r 

<0.01 

0.41 

White 

median 

77 

83 

76 

84 

mean 

97 

103 

97 

87 

SD 

65 

78 

62 

52 

n 

83 

83 

68 

68 

p 

0.49 

0.26 

Pregnant 

median 

122 

142 

110 

98 

mean 

134 

185 

127 

105 

SD 

77 

140 

71 

57 

n 

75 

75 

81 

81 

p 

<0.01 

<0.05 

Breastfeeding 

median 

131 

127 

116 

97 

mean 

137 

158 

126 

116 

SD 

80 

127 

69 

73 

n 

81 

81 

74 

74 

P 

0.15 

0.30 

Non-breastfeeding 

median 

82 

79 

77 

76 

mean 

105 

111 

98 

100 

SD 

75 

129 

64 

102 

n 

79 

79 

79 

79 

P 

0.71 

0.87 

Children 

median 

62 

73 

77 

70 

mean 

76 

109 

81 

84 

SD 

44 

93 

40 

51 

n 

94 

94 

87 

87 

P 

<0.01 

0.63 
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Table  D-20 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

No  FFQs  Dropped 

Iron  (mg) 

Harvard 

Block 

Recalls  FFQ-2 

Recalls  FFQ-2 

All  Women 

median 

14.2 

9.6 

13.6  8.9 

mean 

14.5 

12.5 

14.3  10.1 

SD 

5.2 

12.1 

5.5  7.1 

n 

235 

235 

234  234 

P 

<0.05 

<0.01 

African  American 

median 

15.2 

9.9 

13.9  9.2 

mean 

15.5 

12.2 

15.0  10.1 

SD 

5.2 

9.5 

5.9  6.1 

n 

81 

81 

82  82 

P 

<0.01 

<0.01 

Hispanic 

median 

13.2 

12.5 

13.5  9.6 

mean 

14.3 

17.6 

13.9  11.5 

SO 

5.1 

17.7 

5.4  9.6 

n 

71 

71 

84  84 

P 

0.10 

0.06 

wniie 

median 

12.7 

7.6 

13.1  8.0 

mean 

13.5 

8.3 

13.9  8.5 

CO 

5.0 

4.7 

5.2  3.5 

n 

83 

83 

68  68 

P 

<0.01 

<0.01 

Pregnant 

median 

14.2 

10.6 

14.4  9.3 

mean 

15.6 

12.7 

15.1  10.2 

5.6 

9.5 

5.6  5.4 

n 

75 

75 

81  81 

P 

<0.05 

<0.01 

DreasTreeaing 

median 

14.5 

10.1 

14.1  9.9 

mean 

14.5 

14.2 

15.0  11.0 

SD 

4.3 

15.8 

5.7  5.8 

n 

81 

81 

74  74 

P 

0.87 

<0.01 

Non-breastfeeding 

median 

12.3 

7.8 

11.3  7.6 

mean 

13.3 

10.5 

12.8  9.3 

SD 

5.3 

9.6 

5.1  9.5 

n 

79 

79 

79  79 

P 

<0.05 

<0.01 

Children 

median 

9.7 

8.3 

9.6  6.1 

mean 

10.2 

9.4 

10.3  6.9 

SD 

3.4 

6.3 

3.7  3.3 

n 

94 

94 

87  87 

P 

0.32 

<0.01 
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Table  D-21 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

No  FFQs  Dropped 

Calcium  (mg) 

Harvard 

DiOCK 

Recalls 

FFQ-2 

Recalls  FFQ-2 

All  Women 

median 

989 

834  905 

mean 

876 

1,098 

893  1,100 

SO 

382 

755 

M nn  TOO 

400  788 

n 

235 

235 

234  234 

P 

<0.01 

<0,01 

African  American 

median 

1 OO 

899 

717  819 

mean 

800 

1,028 

799        1 ,042 

SD 

365 

688 

376  836 

n 

81 

81 

82  82 

P 

<0.01 

<0.01 

Hispanic 

median 

1,236 

835  905 

mean 

892 

1,341 

891         1 ,097 

SD 

339 

938 

355  782 

n 

71 

71 

84  84 

P 

<0.01 

<0.05 

White 

median 

966 

1,010  1,037 

mean 

935 

960 

1,009  1,173 

SD 

424 

581 

452  742 

n 

83 

83 

68  68 

P 

0,70 

0.05 

Pregnant 

median 

1,149 

1,023  949 

mean 

953 

1,240 

1,030  1,144 

SD 

418 

736 

439  683 

n 

75 

75 

81  81 

P 

<0.01 

0.14 

Breastfeeding 

median 

897 

1,042 

865  1,049 

mean 

942 

1,180 

915  1,242 

SD 

365 

785 

353  793 

n 

81 

81 

74  74 

P 

<0.01 

<0.01 

Non-breastfeeding 

median 

713 

749 

656  726 

mean 

734 

880 

733  922 

SD 

326 

699 

342  859 

n 

79 

79 

79  79 

P 

0.07 

<0.05 

Children 

median 

627 

816 

715  955 

mean 

682 

910 

756  1,032 

SD 

263 

510 

272  570 

n 

94 

94 

87  87 

P 

<0.01 

<0.01 
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Table  D-22 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

Outlier  FFQs  Dropped 

Energy  (kcal) 

Harvard 

Block 

Recalls 

FFQ-2 

Recalls  FFQ-2 

All  Women 

median 

1,871 

1,706 

1,998  1,643 

mean 

1,988 

1,789 

2,040       1 ,793 

SD 

601 

793 

650  803 

n 

215 

215 

197  197 

<0.01 

<0.01 

African  American 

median 

2,164 

1,758 

2,279  1,699 

mean 

2,213 

1,839 

2,249  1,923 

SD 

665 

886 

685  974 

n 

73 

73 

66  66 

P 

<0.01 

<001 

Hispanic 

median 

1,695 

1,998 

1,861  1,607 

mean 

1,777 

1,944 

1,938  1.732 

SD 

441 

771 

567  762 

n 

60 

60 

74  74 

n 
H 

0.13 

0.06 

White 

median 

1,868 

1,589 

1,824  1,705 

mean 

1,942 

1,630 

1,932  1,721 

SD 

582 

698 

662  607 

n 

82 

82 

57  57 

n 

H 

<0.01 

<0.05 

Pregnant 

median 

2,091 

1,904 

2,087  1,700 

mean 

2,135 

1,940 

2,155  1,833 

SD 

601 

743 

646  631 

n 

69 

69 

66  66 

n 
H 

<0.05 

<0.01 

Breastfeeding 

median 

1,922 

1,791 

2,056  1,699 

mean 

2,023 

1,848 

2,047  1,860 

SD 

554 

744 

604  903 

n 

73 

73 

70  70 

P 

<0.05 

0.09 

Non-breastfeeding 

median 

1,634 

1,458 

1,721  1,436 

mean 

1,814 

1,587 

1,909  1,672 

SD 

612 

853 

691  846 

n 

73 

73 

61  61 

P 

<0.05 

0.07 

Children 

median 

1,229 

1,346 

1,402  1,182 

mean 

1,276 

1,503 

1,361  1,301 

SD 

404 

596 

385  421 

n 

88 

88 

77  77 

P 

<0.01 

0.28 
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Table  D-23 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

Outlier  FFQs  Dropped 

Protein  (g) 

Harvard 

Block 

Recalls  FFQ-2 

Recalls  FFQ-2 

All  Women 

median 

76.9 

63.1 

fO.O  (1.4 

mean 

79.4 

64.9 

81.7  79.3 

25.7 

29.3 

28.2  36.9 

fl 

215 

215 

197  197 

P 

<0.01 

0.40 

African  American 

median 

85.6 

64.0 

OO./  tO.Á 

mean 

86.2 

67.0 

86.3  88.2 

SD 

27.5 

33.9 

28.9  45.1 

n 

73 

73 

66  66 

p 

<u.Ln 

0.72 

Hispanic 

median 

75.0 

70.8 

TA  7              CO  1 

mean 

75.3 

70.8 

80.5  73.6 

in 

21.0 

27.9 

27.3  32.6 

/) 

60 

60 

74  74 

P 

n  "iTi 
U.oU 

U.lb 

wnite 

median 

72.3 

57.1 

7^  O            71  fl 

mean 

76.2 

58.6 

■7-7  Q              7C  ^ 

SD 

26.1 

24.8 

28.5  29.6 

82 

82 

57  57 

r% 
H 

U.  /  0 

Pregnant 

median 

81.3 

66.0 

flO  A            TA  9 
o9.4            /  «t.^ 

mean 

83.5 

68.8 

00.0  fS.U 

27.6 

28.2 

29.4  29.4 

69 

69 

66  66 

<0.0o 

Breastfeeding 

median 

80.5 

66.7 

7fl  0            lA  0 

mean 

oñ  n 

on  A          0*3  fi 
0U.4  00.0 

cn 

23.7 

28.5 

26.1  37.7 

73 

73 

70  70 

n 
P 

<0.01 

0.46 

iNon-DreastTccuing 

median 

69.1 

55.5 

7^  1            At  1 

mean 

72.4 

57.0 

SD 

24.4 

29.9 

28.2  42.7 

n 

73 

73 

61  61 

P 

<0.01 

0.84 

Children 

median 

48.4 

51.2 

50.8  56.2 

mean 

48.1 

55.2 

52.4  58.7 

SD 

147 

23.2 

14.8  18.6 

n 

88 

88 

77  77 

P 

<0.01 

<0.05 
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Table  D-24 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

Outlier  FFQs  Dropped 

Vitamin  A  (RE) 

Harvard 

Block 

Recalls  FFQ-2 

Recalls  FFQ-2 

All    \  *  /  ^    _   

All  Women 

median 

763 

1,143 

811  1,063 

mean 

877 

1,440 

927  1,409 

SD 

499 

1,170 

498  1.140 

n 

215 

215 

197  197 

P 

<0.01 

<0.01 

African  American 

median 

703 

1,089 

844  1,145 

mean 

853 

1,329 

940  1,528 

SD 

490 

918 

514  1,404 

n 

73 

73 

66  66 

P 

<0.01 

<0.01 

Hispanic 

median 

746 

1,695 

691  959 

mean 

843 

2,076 

860        1 ,351 

SD 

525 

1,629 

493           1 ,068 

n 

60 

60 

74  74 

P 

<0.01 

<0.01 

White 

median 

829 

1,032 

873  1,106 

mean 

923 

1 ,072 

1,000  1,348 

SD 

490 

697 

483  864 

n 

82 

82 

57  57 

P 

0.10 

<0.01 

Pregnant 

median 

814 

1,330 

AAA                  A   A J  f 

888         1 ,045 

mean 

959 

1,588 

1,007  1,419 

SD 

530 

1,157 

544  1,199 

n 

69 

69 

66  66 

P 

<0.01 

<0.01 

Breastfeeding 

median 

OH  A 

819  1,389 

mean 

922 

1,689 

930  1,531 

SD 

475 

1,376 

465  970 

n 

73 

73 

70  70 

P 

<0.01 

<0.01 

Non-breastfeeding 

median 

630 

845 

755  915 

mean 

755 

1,050 

837        1 ,259 

SD 

475 

820 

476           1 ,250 

n 

73 

73 

61  61 

P 

<0.01 

<0.05 

Children 

median 

544 

782 

546  835 

mean 

623 

939 

588  867 

SD 

302 

585 

265  356 

n 

88 

88 

77  77 

P 

<0.01 

<0.01 
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Table  D-25 

Nutrient  Compa 

risons  of  Diet  Recalls 

and  FFQ 

-2  Estimates 

Outlier  FFQs  Dropped 

Vitamin  C  (mg) 

Harvard 

Block 

Recalls  FFQ-2 

Recalls  FFQ-2 

All  Women 

median 

107 

99 

104 

97 

mean 

124 

iZO 

\ZZ 

•tin 

SD 

79 

97 

70 

66 

n 

215 

215 

197 

197 

P 

0,79 

0.05 

African  American 

median 

141 

104 

89 

96 

mean 

14o 

lOCJ 

lio 

SD 

80 

110 

69 

58 

n 

73 

73 

66 

66 

P 

0.59 

0.57 

Hispanic 

median 

111 

111 

138 

101 

mean 

132 

148 

1  AC 

so 

86 

108 

71 

78 

n 

60 

60 

74 

74 

P 

0.28 

0.06 

White 

median 

78 

83 

88 

89 

mean 

no 

yo 

on 

1 

SD 

65 

66 

64 

53 

n 

82 

82 

57 

57 

P 

0.92 

0.45 

Pregnant 

median 

121 

124 

113 

101 

mean 

1  jU 

iDI 

1  Z8 

SD 

75 

113 

72 

49 

n 

69 

69 

66 

66 

P 

<0.05 

<0.05 

Breastfeeding 

median 

128 

118 

119 

99 

mean 

137 

134 

129 

117 

SD 

82 

92 

69 

68 

n 

73 

73 

70 

70 

P 

0.80 

0.21 

Non-breastfeeding 

median 

79 

73 

88 

88 

mean 

104 

83 

105 

105 

SD 

77 

65 

67 

79 

n 

73 

73 

61 

61 

P 

0.08 

0.95 

Children 

median 

62 

70 

76 

69 

mean 

76 

96 

82 

83 

SD 

45 

70 

41 

47 

n 

88 

88 

77 

77 

P 

<0.05 

0.98 
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Table  D-26 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

Outlier  FFQs  Dropped 

Iron  (mg) 

Harvard 

RInrk 

Recalls  FFQ-2 

Recalls  FFQ-2 

All  Women 

median 

14.1  9.7 

mean 

14.3 

9.7 

14.7  10.4 

SO 

5.1 

4.8 

n 

215 

215 

197  197 

P 

<0.01 

<0.01 

African  American 

median 

15  S 

1  w*w 

9  A 

14.2  10.4 

mean 

15.7 

9.7 

15.6  11.1 

SD 

5.3 

4.8 

5.8  5.4 

n 

73 

73 

66  66 

P 

<0.01 

<0.01 

Hispanic 

median 

19  4 

11  A 

14.1  9.8 

mean 

13.5 

11.8 

14.2  10.5 

SD 

4.7 

5.2 

^  A                     A  ^ 

n 

60 

60 

74  74 

P 

0.06 

<0.01 

White 

median 

13  9 

7  5 

14.1  9.0 

mean 

13.5 

8.0 

14.4  9.3 

SD 

5.0 

3.7 

5.4  3.1 

n 

82 

82 

57  57 

P 

<0.01 

<0.01 

Pregnant 

median 

1A  9 

10  9 

14.5  9.9 

mean 

15.7 

10.4 

15.4  10.5 

SD 

5.7 

4.5 

5.0  0.4 

n 

69 

69 

66  66 

P 

<0.01 

<0.01 

Breastfeeding 

median 

14.3 

9.3 

14.5  10.0 

mean 

14.0 

10.3 

15.3  10.9 

SD 

4.2 

5.0 

K.  a                   A  Q 
3.0  I.? 

n 

73 

73 

70  70 

P 

<0.01 

<0.01 

Non-breastfeeding 

median 

12.3 

7.7 

12.7  8.6 

mean 

13.2 

8.3 

13.3  9.7 

SD 

5.0 

4.6 

5.2  4.9 

n 

73 

73 

61  61 

P 

<0.01 

<0.01 

Children 

median 

9.7 

7.7 

9.6  6.2 

mean 

10.2 

8.3 

10.3  7.0 

SD 

3.4 

3.4 

3.6  2.6 

n 

88 

88 

77  77 

P 

<0.01 

<0.01 
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Table  D-27 

Nutrient  Comparisons  of  Diet  Recalls  and  FFQ-2  Estimates 

Outlier  FFQs  Dropped 

Calcium  (mg) 

Harvard 

Block 

Recalls  FFQ-2 

Recalls  FFQ-2 

All  Women 

median 

844 

933 

873  948 

mean 

877 

939 

918  1,155 

so 

379 

485 

400  764 

n 

215 

215 

197  197 

P 

<0.05 

<0  01 

African  American 

median 

784 

800 

776  868 

mean 

817 

887 

827  1,119 

SD 

374 

510 

375  837 

n 

73 

73 

66  66 

P 

0.17 

<0.01 

Hispanic 

median 

865 

1.110 

835  916 

mean 

865 

1,020 

908  1,091 

SD 

304 

432 

360  719 

n 

60 

60 

74  74 

P 

<0.05 

<0.05 

White 

median 

857 

962 

1.030  1.178 

mean 

940 

926 

1 ,038       1 .282 

SD 

424 

498 

451  729 

n 

82 

82 

57  57 

P 

0.78 

<0.05 

Pregnant 

median 

895 

1,144 

1,034  1.039 

mean 

967 

1 ,097 

1.069  1,216 

SD 

398 

495 

436  631 

n 

69 

69 

66  66 

P 

<0  05 

0.07 

Breastfeeding 

median 

896 

958 

881  1,102 

mean 

940 

1,005 

930  1,250 

SD 

372 

466 

353  775 

n 

73 

73 

70  70 

P 

021 

<0.01 

Non-breastfeeding 

median 

713 

706 

656  789 

mean 

729 

724 

742  980 

SD 

322 

421 

343  859 

n 

73 

73 

61  61 

P 

092 

I 

<0.05 

Children 

median 

623 

789 

691  951 

mean 

674 

846 

738        1 ,007 

SD 

264 

378 

274  468 

n 

88 

88 

77  77 

P 

<0.01 

<001 
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APPENDIX  E 


MISCELLANEOUS  APPENDICES 

•  Development  of  Modified  Block  FFQ  Appendix  E- 1 
Development  of  Block  FFQ  Food  List  and  Portion  Sizes 

for  Children 

Description  of  Modifications  to  Block  FFQ  for  this  Study 

Development  of  Block  Manual  Scores 

Instructions  for  Manual  Scoring  of  Modified  Block  FFQ 

•  Problems  Encountered  in  the  Use  of  the  Harvard  FFQ  Appendix  E-2 
Reliability  of  the  WICENTER  Program 

Errors  Encountered  in  the  Harvard  FFQ,  Scoring  Templates 
and  Instructions 

•  Decision  Rules  for  Editing  Dietary  Recall  Data  Appendix  E-3 

•  Guidelines  for  FFQ  Usability  Assessment  Appendix  E-4 

•  Suggested  Changes  to  Improve  the  Block  FFQ  Appendix  E-5 

•  National  Estimates  of  Nutrient  Intake  for  WIC  Women 

And  Children  Appendix  E-6 
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APPENDIX  E-1 


DEVELOPMENT  OF  MODIFIED  BLOCK  FFQ 

The  Block  FFQ  used  in  this  study  are  modifications  of  the  Block/NCI  Health  Habits 
and  History  Questionnaire  (Block  et  al.,  1986).  This  appendix  describes  the  development  of 
the  children's  FFQ,  the  specific  ways  in  which  the  FFQ  food  list  used  here  differs  fi^om  earlier 
versions,  the  development  of  the  FFQ  manual  scoring  system,  and  instructions  for  scoring  the 
Block  FFQ. 

Development  of  Block  FFQ  Food  List  and  Portion  Sizes  for  Children 

Food  List 

The  food  list  used  for  women  in  the  present  study  was  determined  after  examination  of 
1 )  NHANES  n  data  on  nutrient  sources  among  young  female  Whites  and  Afiican  Americans, 
and  among  low-income  persons  (Block,  unpublished  data);  and  2)  Hispanic  HANES 
(HHANES)  data  on  nutrient  sources  among  low-income  Hispanic  women  (Block  et  al.,  1994). 
Modifications  to  the  resulting  food  list  for  children  were  minimal,  and  were  based  on  nutrient 
sources  lists  in  HHANES  for  low-income  children,  ages  1-4.  These  modifications  chiefly 
involved  omitting  alcoholic  beverages;  adding  "Baby  food  fiiiit";  changing  the  wording  of 
"cooked  cereals,  grits"  to  "cooked  cereals,  grits,  hot  baby  food  cereals";  dropping  the  reference 
to  coffee/tea  and  moving  sugar  to  the  cereal  section  Thus,  the  food  list  for  children  was 
essentially  identical  to  that  for  adults.  In  Section  5,  a  suggestion  is  made  for  fiirther  analyses  in 
the  existing  data  set,  to  explore  whether  a  substantially  reduced  food  list  might  improve 
correlations. 
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Nutrient  Content 

Nutrient  contents  of  the  foods  on  the  list  were  not  changed  from  those  on  the  adult 
database.  Nutrients  for  "baby  food  fruit"  were  based  upon  comparable  items  in  Revised 
Handbook  8. 

Portion  Sizes 

Portion  sizes  for  all  foods  on  the  children's  food  list  were  derived  from  an  examination 
of  the  HHANES  portion  sizes  for  low-income  children  in  this  age  group.  This  survey,  based 
on  a  national  sample,  used  three-dimensional  models  to  assist  the  respondents  in  estimating 
portion  size,  and  were  thought  to  provide  good  data  on  actual  amounts  consumed  by  children. 
The  portion  sizes  used  for  adults  on  the  Block  database  had  been  developed  in  an  exactly 
analogous  way,  among  the  adults  in  NHANES  II. 

The  individual  food  codes  on  the  HHANES  database  were  re-coded  to  group  them 
into  similar  items  corresponding  to  the  foods  on  the  FFQ.  For  example,  1 1  HANES  codes  for 
green  beans  were  re-coded  into  a  single  item,  "green  beans".  The  gram  portion  size  responses 
for  all  HHANES  responses  from  all  low-income  respondents,  aged  1-4,  were  then  arrayed. 
Thus,  for  each  of  the  62  items  on  the  child's  FFQ,  actual  reported  gram  portion  sizes  were 
arrayed,  and  a  small,  medium  and  large  amount  identified.  This  was  done  separately  for 
children  1-2  and  3-4  as  well  as  combined.  It  was  found  that  for  some  foods,  it  was  necessary 
to  have  two  different  portion  size  sets  for  the  two  age  groups,  although  this  was  not  necessary 
for  all  foods.  "Medium"  was  identified  as  the  median  amount  consumed  in  that  age  group,  or  a 
large  mode  close  to  that  median.  "Small"  and  "large"  were  identified  as  large  modes  above  and 
below  the  medium. 

Description  of  Modifications  to  Block  FFQ  for  this  Study 

As  described  in  Section  3  .3,  wording  and  items  of  the  Block  FFQ  were  modified 
somewhat  for  this  study.  The  food  list  was  essentially  a  modification  of  the  Block  60-item 
FFQ,  described  in  (Block,  G.,  1990)  and  used  in  the  1987  and  1992  National  Health  Interview 
Surveys.  The  modifications  were  undertaken  to  simplify  the  wording  of  some  of  the  items, 
necessary  because  of  the  probable  literacy  level  of  the  study  population  and  the  fact  that  it  was 
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to  be  self-administered  rather  than  administered  by  interview  as  the  NHIS  surveys  were.  In 
addition,  some  items  were  omitted  as  being  relatively  unimportant  in  this  population.  Some 
items  were  combined,  particularly  because  assessment  of  the  different  types  of  fat  was  not  a 
goal  of  WIC.  Some  items  were  separated  into  two  items,  to  better  capture  some  foods 
important  in  the  WIC  or  in  the  Hispanic  population.  And  some  items  were  added,  for  the  same 
reason. 

The  following  list  shows  differences  between  the  1992  NHIS  version  of  the  Block  FFQ 
and  the  version  used  for  this  study.  Other  versions  of  the  "60-item  version"  of  the  Block  FFQ 
contain  slightly  different  wordings  or  items. 

Items  Unchanged 
Bananas 
Oranges 
Green  salad 
Broccoli 

Sweet  potatoes,  yams 

Any  other  vegetable 

Rice 

Eggs 

Pizza 

Biscuits,  muflSns 

Liver  including  chicken  liver 

Pork,  pork  chops,  roasts 

Fried  chicken 

Hot  dogs 

Peanuts,  peanut  butter 

Items  Added 

Apple  juice,  grape  juice 

Cooked  green  peppers,  chile  rellenos 
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Milk  on  cereal 

Tuna  sandwich  or  tuna  casserole 
Any  other  soup  —  [i.e.,  other  than  vegetable] 
Salsa,  taco  sauce,  ketchup,  hot  red  peppers 
Flour  tortillas 

Yogurt,  frozen  yogurt  (including  lowfat) 

Items  Omitted 
Grapefruit 

High  fiber  cereals  like  bran,  granóla,  or  shredded  wheat 
Highly  fortified  cereals  like  Product  19,  Total,  or  Just  Right 
Dark  breads  like  whole  wheat,  rye  or  pumpernickel 
Pie 

Chicken  stew  or  chicken  pot  pie 
Fish  broiled  or  baked 

Items  Combined 
"Greens,  spinach" 

instead  of  two  items,  "Spinach"  and  "Mustard  greens,  turnip  greens  or 

collards" 
"Potatoes,  including  French  fiies" 

instead  of  two  items,  "French  fiies  or  fiied  potatoes"  and  "Potatoes,  baked, 

boiled  or  mashed" 
"Bacon,  sausage,  links" 

instead  of  two  items,  "Bacon"  and  "Sausage" 
"Margarine  or  butter" 

instead  of  two  items,  "Butter  on  bread,  rolls  or  vegetables"  and  "Margarine  on 

bread,  rolls  or  vegetables" 
"Lowfat  and  skim  milk  (not  including  milk  on  cereal)" 
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instead  of  two  items,  "2%  milk  or  drinks  made  with  2%  milk,  not  including  on 
cereal"  and  "Skim  milk,  1%  milk  or  buttermilk,  not  including  on  cereal" 

Separated  Into  Two  Items 

"Chili  with  meat  or  beans  (American  style)"  and  "Beans  like  pinto  or  refried  beans" 
instead  of  "Beans,  such  as  baked,  pinto,  kidney  beans,  or  in  chili" 

"Com  tortillas"  and  "Com  bread,  com  muffins" 

instead  of  "Com  bread,  com  muffins,  com  tortillas,  or  grits" 

"Cake,  cookies"  and  "Donuts,  pastry" 

instead  of  "Doughnuts,  cookies,  cake  or  pastry" 

Items  Reworded 
"Peaches,  cantaloupe" 

instead  of  "Cantaloupe  in  season" 
"Apples,  grapes  or  any  other  fruit" 

instead  of  "Apples  or  applesauce" 
"Orange  juice" 

instead  of  "Orange  juice  or  grapefruit  juice" 
"Kool-Aid,  fruit  drinks,  Hi-C" 

instead  of  "Other  fruit  juices  or  fortified  fiiiit  drinks" 
"Carrots" 

instead  of  "Carrots,  or  mixed  vegetables  containing  carrots" 
"Tomatoes" 

instead  of  "Tomatoes,  including  in  salad" 
"Salad  dressing" 

instead  of  "Salad  dressing  or  mayonnaise,  including  on  sandwiches" 
"Any  other  vegetable" 

instead  of  "Any  other  vegetable,  such  as  string  beans,  peas,  com" 
"Cole  slaw,  cabbage" 

instead  of  "Coleslaw,  cabbage  or  sauerkraut" 
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"Cooked  cereals,  grits" 

instead  of  "Cooked  cereals  like  oatmeal" 
"Cold  cereals,  such  as  Cheerios,  with  or  without  milk" 

instead  of  "Other  cold  cereals  like  Rice  Krispies  or  com  flakes" 
"Spaghetti  with  tomato  sauce" 

instead  of  "Spaghetti,  lasagna  or  pasta  with  tomato  sauce" 
"Mixed  dishes  with  cheese,  macaroni  and  cheese" 

instead  of  "Macaroni  and  cheese,  other  mixed  dishes  with  cheese" 
"Hamburgers,  cheeseburgers,  beef  burritos,  tacos" 

instead  of  "Hamburgers,  cheeseburgers  or  meatballs" 
"Beef  (steak  or  roast),  ribs" 

instead  of  "Beef,  such  as  steaks  or  roasts" 
"Mixed  dishes  with  beef  like  beef  stew" 

instead  of  "Beef  stew  or  potpie  with  vegetables" 
"Other  chicken  (stewed,  baked  or  roasted" 

instead  of  "Chicken  or  turkey,  baked,  stewed  or  broiled" 
"Fish,  fish  sandwich" 

instead  of  "Fried  fish  or  fish  sandwich" 
"Vegetable  soup,  tomato  soup" 

instead  of  "Vegetable  soup,  vegetable  beef,  minestrone  or  tomato  soup" 
"Lunch  meats,  sliced  ham" 

instead  of  "Ham  or  lunch  meats" 
"Cheese  and  cheese  spread" 

instead  of  "Cheese  or  cheese  spreads,  not  including  cottage  cheese" 
"Bread,  including  sandwiches,  bagels  and  burger  rolls" 

instead  of  "White  bread,  rolls  or  crackers,  including  sandwiches,  bagels  and  so 

forth" 

"Chips,  popcorn,  crackers,  pork  skins" 

instead  of  "Salty  snacks  like  chips  or  popcorn" 
"Ice  cream  or  pudding" 
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instead  of  "Ice  cream  not  including  fat  free  ice  cream" 
"Chocolate  candy,  candy  bars" 

instead  of  "Chocolate  candy" 
"Milk  or  cream  in  coflfee  or  tea" 

instead  of  "Milk  or  cream  in  coflfee  or  tea  including  nondairy  creamer" 
"Regular  milk  (not  including  milk  on  cereal" 

instead  of  "Whole  milk  or  drinks  made  with  whole  milk,  not  including  on 

cereal" 

"Regular  soft  drinks  (not  diet  soda)" 

instead  of  "Non-diet  soda  or  soft  drinks" 
"Beer,  all  types" 

instead  of"...  beer" 
"All  types  of  wine,  wine  coolers" 

instead  of"...  wine" 
"Liquor  (all  types) 

instead  of"...  liquor" 
"Sugar  in  coflfee,  tea  or  on  cereal  (not  sugar  substitutes) 

instead  of  "Sugar  in  coflfee  or  tea  or  on  cereal" 


Development  of  Block  Manual  Scores 

The  Block  manual  scores  were  designed  to  identify  persons  with  high  or  low 
intake  of  five  nutrients  of  interest  to  WIC:  calcium,  iron,  protein,  vitamin  A  and  vitamin  C. 
Previous  work  has  shown  (Byers  et  al.,  1985,  Block  et  al.,  1989)  that  very  short  lists  of 
foods  can  rank  persons  reasonably  well  provided  that  they  are  selected  correctly.  To  this 
end,  the  most  important  contributors  of  those  nutrients  were  identified  for  Airican 
Americans  and  whites  in  the  NHANES  II  data  (Block  et  al.,  1985a,  1985b)  and  for 
Hispanics  in  the  Hispanic  HANES  data  (Block  et  al.,  1994).  The  top  10-19  foods  were 
selected,  the  indicator  foods,  representing  approximately  70%  of  the  intake  of  those 
nutrients  in  these  national  data  sets. 
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To  simplify  scoring,  the  frequency  categories  on  the  FFQ  (3-4/week,  2+/day,  etc.) 
were  each  assigned  a  value  from  zero  to  4  (0  to  6  for  beverages).  See  the  small  numbers 
at  the  bottom  of  each  column  of  the  Block  FFQ,  Appendix  A. 


Consumption  of  foods  less  than  once  per  week 

0  points 

Consumption  of  foods  1  -2  times  per  week 

1  point 

Consumption  of  foods  3-6  times  per  week 

2  points 

Consumption  of  foods  1  time  per  day 

3  points 

Consumption  of  foods  2+  times  ner  day 

4  points 

For  beverages  the  frequency  categories  on  the  FFQ  permit 

more  frequent 

consumption.  Therefore,  the  scoring  was  slightly  different  for  beverages: 

Consumption  of  foods  less  than  twice  per  week 

0  points 

Consumption  of  foods  2-4  times  per  week 

1  point 

Consumption  of  foods  5-6  times  per  week 

2  points 

Consumption  of  foods  1  time  per  day 

3  points 

Consumption  of  foods  2  times  per  day 

4  points 

Consumption  of  foods  3-4  times  per  day 

5  points 

Consumption  of  foods  5-6  times  per  day 

6  points 

Only  the  indicator  foods  are  given  a  score.  This  produces  a  one-digit  interim  score 
for  each  nutrient  on  each  page,  added  at  the  end  of  the  booklet  for  the  total  nutrient  score. 
The  result  is  a  continuous  variable,  with  total  scores  ranging  from  zero  to  76  points.  If  a 
"pass/fail"  criterion  is  needed,  this  variable  can  be  used  with  any  cutpoint  along  its  range, 
to  achieve  the  "proportion  eligible"  affordable  by  funding  constraints.  As  shown  in 
Section  4.2,  scoring  took  a  median  of  three  minutes. 

For  the  present  study,  arbitrary  cutpoints  had  to  be  selected  a  priori  in  order  to 
permit  "pass/fail"  comparisons  with  the  Harvard  manual  score  (which  provides  only 
pass/fail  scores).  To  achieve  this,  an  attempt  was  made  to  determine  cutpoints  that  would 
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correspond  to  the  RDA.  First,  the  nutrient  estimates  from  the  Block  flill  FFQ  were 
calculated,  and  then  their  distribution  adjusted  to  correspond  approximately  to  the 
distribution  of  nutrient  intakes  seen  among  women  (or  children)  in  this  age-income 
category  in  CSFII  1986.  The  CART  procedure  (Classification  and  Regression  Trees)  was 
then  used  to  identify  that  manual  score  cutpoint  that  best  classified  the  sample  with  respect 
to  the  RDA  of  the  adjusted  FFQ  nutrient  estimate.  The  same  procedure  was  used  to 
identify  a  cutpoint  corresponding  to  1.5x  RDA  of  the  adjusted  FFQ  nutrient  estimate. 
That  is,  manual  score  cutpoints  were  developed  by  reference  to  the  adjusted  FFQ 
distribution,  and  not  by  reference  to  the  24-hour  recall  distribution.  The  recalls  were  used 
only  to  test  the  success  of  the  cutpoints  that  had  been  devised  as  just  described. 

The  cutpoints  used  in  the  present  analysis  are  shown  in  the  following. 


Cutpoints  for  Adults 


Nutrients 

Low 

Adequate 

Ample 

Vitamin  C 

7  or  less 

8 

9  or  more 

Vitamin  A 

12  or  less 

13 

14  or  more 

Protein 

9  or  less 

10-13 

14  or  more 

Iron 

16  or  less 

17-24 

25  or  more 

Calcium 

1 5  or  less 

16-18 

19  or  more 

("Low"  =  Less  than  RDA;  "Ample"  =  >  L5x  RDA.  Exception:  for  Calcium  in  adults, 
"Low"  =  <  800  mg,  "Ample"  =  >  1200  mg.) 
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Cutpoints  for  Children,  Age  1-4 


iNuincnis 

Low 

Adequate 

Ampie 

Vitamin  C 

8  or  less 

9-12 

13  or  more 

Vitamin  A 

14  or  less 

15-20 

21  or  more 

Protein 

5  or  less 

6-7 

8  or  more 

Iron 

1 8  or  less 

19-22 

23  or  more 

Calcium 

16  or  less 

17-20 

2 1  or  more 

("Low"  =  Less  than  RDA;  "Ample"  =  >  L5x  RDA.  Exception:  for  Calcium  in  adults, 
"Low"  =  <  800  mg,  "Ample"  =  >  1200  mg.) 


However,  as  can  been  seen  in  Table  4-25,  these  cutpoints  did  not  always 
correspond  well  to  the  nutrient  distribution  seen  in  the  24-hour  recalls  in  the  present  study. 
The  following  cutpoints  may  approximate  better  the  RDA  levels  among  African  American 
and  White  women  seen  in  this  study: 


Cutpoints  for  Adults 

Nutrients 

Low 

Vitamin  C 

9  or  less 

Vitamin  A 

16  or  less 

Protein 

10  or  less 

Iron 

20  or  less 

Calcium 

17  or  less 
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Instructions  for  Manual  Scoring  of  Modiried  Block  FFQ 

In  this  study,  the  following  instructions  were  provided  to  field  aides  for  scoring  the 
Block  FFQs  manually. 


Scoring  the  Block  FFQ 

•  At  the  bottom  of  each  column  a  person  has  marked,  there  is  a  corresponding  scoring 
number. 

•  Look  at  the  scoring  number  for  each  column  and  write  this  number  in  ^  of  the  shaded 
boxes  on  the  right-hand  side  of  the  page 

•  If  there  are  no  shaded  boxes  for  a  particular  food,  do  not  write  anything. 

•  Do  this  for  all  of  the  pages.  Note  on  page  4,  there  are  different  sets  of  scoring 
numbers  for  both  grids. 

•  Next  add  the  numbers  in  each  column  of  the  shaded  boxes  on  each  page.  Write  the 
total  for  each  column  in  the  shaded  box  at  the  bottom  for  Vitamin  C,  Vitamin  A, 
Protein,  Iron  and  Calcium. 

•  Transfer  the  totals  for  each  page  to  the  summary  boxes  on  page  5. 

•  Add  the  columns  in  the  summary  boxes  to  get  an  FFQ  total  score  for  Vitamin  C, 
Vitamin  A,  Protein,  Iron  and  Calcium 
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APPENDIX  E-2 


PROBLEMS  ENCOUNTERED  IN  THE  USE  OF  THE  HARVARD  FFQ 

Reliability  of  the  WICENTER  Program 

A  number  of  tests  were  conducted  to  determine  the  reliability  of  the  Harvard 
WICENTER  software  in  generating  consistent  nutrient  calculations  It  was  found  that  the 
women's  program,  ENTERW,  calculated  nutrient  values  from  the  food  item  scores  in  a 
consistent  manner  The  children's  program,  ENTERC,  when  subjected  to  the  same  tests, 
was  found  to  be  unreliable.  In  a  variety  of  situations,  tests  of  the  ENTERC  program 
generated  age  3  through  4  values  for  children  ages  1  through  2  and  vice  versa.  These  tests 
are  described  below. 

In  "Test  1,"  a  number  of  Harvard  FFQ  records  were  pulled  from  the  study 
representing  ages  1  00  through  5  04  years  First,  the  data  were  entered  using  solely  the 
ENTERC  program.  Miscalculations  occurred  in  records  with  ages  3.01  and  3.92.  In  the 
second  step,  each  record  was  opened  to  edit  mode  using  the  ENTERC  program  and 
closed  This  produced  correct  and  consistent  calculations  for  all  records 

Significant  problems  also  occurred  when  attempts  were  made  to  alter  a 
participant's  age  on  an  existing  record  using  the  ENTERC  program  For  example,  when 
the  same  Test  1  record  was  re-opened  and  the  birth  date  modified  so  that  the  calculated 
age  would  be  4  00  to  4  92  years,  miscalculations  occurred  in  records  with  initial  ages  1  00, 
1.01,  1  49,  1.96,  2  00,  2  04,  and  2  50  years  When  the  birth  date  was  again  modified  to  an 
age  between  1  00  and  2  50  years,  errors  occurred  in  12  out  of  13  records  with  initial  ages 
1  00  to  4  52  years  When  these  records  were  re-opened  and  closed  again  with  no 
modification,  the  correa  lower  age  calculations  occurred 

In  "Test  2,"  fictitious  test  records  were  entered  using  ENTERC  with  all  food  item 
scores  equal  to  "2"  These  records  were  entered  multiple  times  with  different  birth  dates 
and  calculated  ages  Upon  initial  entry,  one  miscalculation  occurred  at  age  4.00.  When 
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the  same  records  were  simply  opened  and  closed,  another  miscalculation  occurred  at  age 

2.99. 

In  "Test  3,"  a  fictitious  test  record  was  entered  with  all  food  item  scores  equal  to 
"I  "  The  record  was  entered  multiple  times  with  different  birth  dates  and  calculated  ages 
Upon  initial  entry,  no  miscalculations  occurred.  However,  when  the  records  were  simply 
opened  and  closed,  an  error  occurred  at  age  2.99.  When  the  test  was  repeated  with  all 
food  item  scores  equal  to  "2,"  the  same  miscalculation  occurred  at  age  2.99  when  the 
record  was  re-opened  and  closed. 

In  summary,  it  was  observed  that  the  WICENTER  children's  program,  ENTERC, 
will  sometimes  generate  false  values  both  upon  initial  entry  and  during  the  recalculation  of 
an  existing  record  The  results  seem  to  be  particularly  inaccurate  if  the  child's  age  in  an 
existing  record  is  modified.  A  similar  problem  was  observed  in  the  WICENTER  RDA 
display  module  This  on-line  fianction  sometimes  would  display  different  RDA  values  for 
the  same  set  of  food  item  scores. 

For  the  purposes  of  this  validation  study,  a  number  of  steps  were  taken  to  insure 
the  accuracy  of  the  Harvard  FFQ  nutrient  calculations  for  children.  Two  identical  files  of 
unprocessed  records  were  created  In  the  first  file,  the  session  date  and  birth  date  were  set 
so  that  all  the  children  would  have  a  calculated  age  of  1 . 1  years.  In  the  second  file,  dates 
were  set  so  that  the  children  would  all  have  a  calculated  age  of  4.9  years.  Both  files  were 
then  processed  using  the  ENTERC  program  Each  record  was  opened  to  edit  mode  and 
closed,  causing  the  program  to  calculate  the  nutrient  values. 

In  this  manner,  two  files  with  calculated  nutrient  values,  one  with  all  records 
containing  values  for  ages  1  through  2  (low  values),  and  the  other  containing  values  for 
ages  3  through  4  (high  values),  were  created  By  comparing  the  two  files,  it  was 
determined  that  this  procedure  resulted  m  two  completely  distinct  sets  of  nutrient  values, 
one  low  and  one  hjgh  The  high  and  low  nutnent  values  were  then  compared  to  those 
generated  in  the  processed  study  data  which  used  actual  session  dates  and  birth  dates 
This  comparison  confirmed  that  records  m  the  processed  study  file  for  children  ages  1 
through  2  in  fact  contained  the  lower  calculated  nutrient  values  and  that  the  records  for 
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children  ages  3  through  4  contained  the  higher  values.  The  shift  in  calculated  nutrient 
values  from  lower  to  higher  occurred  exactly  at  age  3 

It  was  concluded  from  these  tests  that  the  method  of  data  entry  and  nutrient 
calculation  used  by  the  study  was  consistent  and  reliable  and  generated  the  values  intended 
by  the  designers  of  the  Harvard  WICENTER  program.  Had  the  Harvard  FFQ  data  been 
entered  using  solely  the  WICENTER  programs,  the  resulting  calculations  would  have 
been  both  inconsistent  and  unreliable  for  the  children's  records. 

Errors  Encountered  in  the  Harvard  FFQ,  Scoring  Templates  and  Instructions 

During  data  collection,  several  minor  graphic  errors  were  encountered  in  the  revised 
Harvard  Spanish  FFQ.  Page  2  of  the  scoring  template  does  not  align  property  with  the 
questionnaire  grids  and  score  boxes  on  the  printed  instrument.  Additionally  there  are  two 
extraneous  score  boxes  which  appear  under  columns  8  and  9  on  page  2  of  the  printed 
instrument  Project  field  staff  thought  that  these  errors  made  the  Harvard  Spanish  instrument 
more  difficult  to  score  and  could  resuk  in  erroneous  manual  scores. 

A  discrepancy  was  also  discovered  in  the  Harvard  FFQ  manual  scoring  instructions 
applicable  to  both  the  English  and  Spanish  instruments  In  some  instances,  it  is  possible  to  have 
both  a  positive  (+)  and  a  negative  (-)  result  when  scoring  page  2  Instructions  printed  on  the 
scoring  template  do  not  explain  how  to  score  or  resolve  a  pattern  of  answers  when  it  matches 
two  conflicting  levels  of  the  scoring  gnd 
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DECISION  RULES  FOR  EDITING  DIETARY  RECALL  DATA 

In  some  cases,  nutrient  estimates  from  individual  24-hour  recalls  were  improbably 
high,  and  appeared  to  result  from  erroneous  responses  To  identify  such  recalls 
consistently  and  systematically,  the  following  decision  rules  were  determined  based  on 
examination  of  actual  recall  data. 

Protein  rule:  If  one  recall  is  more  than  twice  the  average  of  the  other  two  recalls, 
exclude  it  Exception:  If  two  of  the  three  are  quite  high  (e.g.,  >  100  gm.),  don't  drop  any. 

Vitamin  C  rule:  If  one  recall  is  more  than  three  times  the  sum  of  the  other  two  recalls, 
exclude  it  Or,  if  one  recall  is  more  than  500  mg  in  that  day,  exclude  it. 

Iron  rule:  If  one  recall  is  more  than  40  mg  and  greater  than  the  sum  of  the  other  two, 
exclude  it.  Or,  if  one  recall  is  more  than  50  mg  in  that  day,  exclude  it. 

Calcium  rule:  If  one  recall  is  more  than  2,500  mg  in  that  day  and  more  than  the  sum  of 
the  other  two  recalls,  exclude  it  Or,  if  one  recall  is  more  than  1,000  mg  in  that  day  and 
more  than  three  times  the  sum  of  the  other  two  recalls,  exclude  it. 

Vitamin  A  rule:  Don't  exclude  any  single  recalls  on  the  basis  of  their  difference  from  the 
other  two  recalls.  (Upon  examination,  most  high  'outliers'  turned  out  to  be  carrots  or 
liver,  which  resuhed  in  legitimate  extreme  values.) 

Energy  rule:  We  did  not  exclude  individual  recalls  on  the  basis  of  energy  considerations. 
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GUIDELINES  FOR  FFQ  USABEUTY  ASSESSMENT 


The  following  instructions  are  excerpted  from  the  guidelines  provided  to  the  WIC  Agencies  in 
Delaware,  North  Dakota  and  Puerto  Rico.  Each  agency  submitted  a  non-quantitative  usability 
assessment  of  the  Harvard  and  Block  FFQs  The  results  are  reported  in  Section  4. 


We  are  examining  the  validity  of  two  different  types  of  food  frequency  questionnaires  for  use  in 
WIC  clinics.  Each  of  these  questionnaires  has  been  self-administered  by  over  700  WIC  clients. 
We  would  like  from  you  a  separate  assessment  of  how  usable  these  questionnaires  might  be  in 
your  context  and  with  your  clients. 

Enclosed  are  twelve  copies  each  of  eight  food  frequency  questionnaires: 


Type  A 

AWE    "A*.  Women's.  English 
ACE     "A'.  Children's.  English 
AWS    'A*.  Women's.  Spanish 
ACS     'A'.  Children's.  Spanish 


Type  B 

BWE    "B".  Women's.  English 
BCE     'B*.  Children's,  English 
BWS    "B*.  Women's,  Spanish 
BCS     "B*.  Children's,  Spanish 


In  order  to  assess  the  usability  of  these  questionnaires  within  your  WIC  program,  it  is  suggested 
you  use  these  questionnaires  with  a  small  numt)er  of  clients.  For  the  purposes  of  the  validation 
study,  you  can  use  each  type  of  questionnaire  with  as  many  as  twelve  WIC  clients.  To  gam  a 
good  assessment  of  usability,  it  is  suggested  that  you  substitute  your  current  questionnaire  or 
assessment  method  with  one  of  the  study  questionnaires  You  may  also  wish  to  have  members 
of  your  staff  review  the  questionnaires  and  provide  an  assessment  of  their  usability. 

Enclosed  are  instructions  for  the  administration,  sconng  and  interpretation  of  each  food 
frequency  questionnaire  type  Samp>les  of  completed  questionnaires  are  also  included  The 
questionnaires  are  designed  to  be  self-administered.  however,  it  is  recommended  that  you  bnefly 
review  the  basic  instructions  for  completing  the  questionnaire  vyith  each  client. 

We  would  ask  that  you  provide  us  a  written  assessment  of  each  of  the  food  frequency 
questionnaires  It  would  be  espeaally  useful  if  you  provide  compansons  of  type  "A"  and  type  "B" 
In  your  assessment,  please  address  the  following  questions  for  both  type  "A"  and  type  "B" 
questionnaires: 


continued 
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Guidelines  for  usability  assessment  -  continued 


•  Did  you  find  the  questionnaires  useful  for  nutrition  education? 

•  Did  you  find  tfie  manual  scoring  systems  useful  for  nutrition  education? 

•  Did  you  find  the  manual  sconng  systems  helpful  in  making  eligibility  decisions? 

•  What  characteristics  of  the  questionnaires  make  them  easy/difficult  to  use  by  WIC  clients? 

•  What  charactenstics  of  the  questionnaires  make  them  easy/difficult  to  administer  by  WIC 
staff? 

•  What  characteristics  of  the  questionnaires  make  them  easy/difficult  to  score  and  interpret  by 
WIC  staff? 

•  How  suitable  are  the  questionnaires  for  use  with  WIC  clients  in  the  following  ethnic  groups: 
Afncan  Americans,  Hispanics.  Whites?  Address  those  groups  who  utilize  your  program. 

Please  feel  free  to  report  any  other  aspect  of  the  questionnaires  which  makes  them  particulariy 
useful  or  hinder  their  use.  You  may  want  to  include  suggestions  for  improving  their 
effectiveness.  Your  assessment  and  input  are  invaluable  to  the  validation  study  and  will  be 
included  in  the  study's  final  report  to  USDA  later  this  year. 
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SUGGESTED  CHANGES  TO  IMPROVE  THE  BLOCK  FFQ 

As  noted  in  Section  4.5,  both  FFQs  consistently  overestimated  calcium  and  vitamin 
A  intake.  This  was  true  to  a  greater  extent  for  the  Harvard  FFQ  than  the  Block  FFQ. 
While  the  Harvard  FFQ  permits  respondents  to  indicate  frequencies  as  high  as  six  times 
per  day  for  all  foods,  the  Block  FFQ  permits  only  a  maximum  of  twice  a  day  for  solid 
foods  However,  for  beverages  the  Block  FFQ  did  permit  respondents  to  indicate 
consumption  as  high  as  five  to  six  times  per  day.  It  was  hypothesized  that  this  beverage 
section  of  the  Block  FFQ,  with  its  high  permissible  frequencies,  might  be  the  source  of 
some  overestimates  (see  Section  4). 

The  Block  nutrient  estimates  were  recalculated  after  re-scoring  all  beverage 
frequencies  higher  than  three  times  per  day  so  that  a  maximum  of  only  three  times  per  day 
was  permitted.  Correlations  of  the  resulting  nutrient  estimates  with  the  diet  recall  data 
were  then  recalculated  using  Spearman  correlations  The  results  are  shown  in  Table  E  5-1 
(FFQ-1).  For  African-American  women,  the  correlations  of  all  nutrients  except  iron  were 
improved  slightly  by  about  0  02  (for  example,  the  correlation  for  calcium  improved  from 
0  45  to  0  47).  Among  White  women  the  improvements  were  more  substantial.  The 
correlation  for  energy  increased  from  0  43  to  0  46,  for  protein  from  0.50  to  0.56,  and  for 
calcium  the  correlation  mcreased  from  0  55  to  0  61  The  result  was  that  among  White 
women  four  of  six  nutnent  correlations  were  above  0.50,  and  two  of  those  were  above 
0.60. 

This  change  also  improved  the  estimates  of  group  means.  For  example,  among 
White  women  the  calcium  estimate  was  reduced  somewhat  (Recall,  1,007  mg,  FFQ,  1,180 
mg),  but  remained  a  significant  overestimate  Vitamin  A  while  still  significantly 
overestimated,  was  less  so  (Recall.  940  RE.  FFQ,  1,166  RE).  A  similar  pattern  of  results 
was  seen  for  the  other  ethnicities  and  for  FFQ-2  (Table  E  5-2). 
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Table  E  5-1 

Changes  in  Correlations  as  a  Result  of  Re-calculating 
Frequency  Categories  for  Milk  Items  with  FFQ-1  Data 

Spearman  correlation  coefficients 
Original 

Calculation      Re-calculation  difference 

African -Am^ricAn  \A/om^n 

Energy 

0.48 

0.50 

0.02 

Protein 

0.45 

0.47 

0  02 

Vitamin  A 

0.24 

0.26 

0  02 

X/itamin  C 

0.35 

0.36 

0.01 

Iron 

0.34 

0.34 

0.00 

wai  ^lu  1  f  1 

0  45 

0  47 

0  02 

HicnAnic  \A/nmAn 

Energy 

0.11 

0.10 

-0.01 

Protein 

0.04 

0.04 

0.00 

Vitamin  A 

0.22 

0.22 

000 

Vitamin  C 

0.19 

0.21 

0.02 

Iron 

-0.05 

-0.05 

0.00 

Calcium 

0.13 

0.13 

0.00 

White  Wonien 

Enerqv 

0  43 

0.46 

0.03 

Protein 

0  50 

0.56 

0.06 

Vitamin  A 

0  60 

0.61 

001 

Vitamin  C 

0  19 

0.24 

0.05 

Iron 

0  50 

0.51 

001 

Calcium 

0  55 

0.61 

006 

All  Women 

Energy 

0.36 

0.37 

001 

Protein 

0  33 

0.34 

0  01 

Vitamin  A 

0  33 

0.33 

0  00 

Vitamin  C 

0  30 

0.33 

0.03 

Iron 

0  23 

0.23 

0.00 

Calcium 

0.39 

0.41 

002 
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Table  E  5-2 

Changes  in  Correlations  as  a  Result  of  Re-calculating 
Frequency  Categories  for  Milk  Items  with  FFQ-2  Data 

Spearman  correlation  coefficients. 

Original 

Calulation       Re-calculation  difference 

nl  1  iMJii'niiid  lOdii  V wiiicii 

Energy 

0.43 

0.44 

0.01 

Protein 

0.41 

0.42 

0.01 

Vitamin  A 

0.13 

0.14 

0  01 

V/itamin  C 

V 1  lai  1  III  1  \^ 

0.35 

0.36 

0.01 

Irnn 

II  Ul  1 

0.44 

0.45 

0.01 

0.40 

0.41 

0.01 

Micn^inif*  \A/rknrwkn 

II 19 UOI 1 IV*   V Vwl  1 ICI 1 

Energy 

0.08 

0.08 

0.00 

Protein 

0.11 

0.11 

0  00 

Vitamin  A 

0.06 

0.07 

0  01 

Vitamin  C 

0.28 

0.27 

'0.01 

Iron 

0.07 

0.07 

0.00 

Calcium 

0.24 

0.23 

-0.01 

White  Women 

Enerqv 

0  45 

0.48 

0  03 

Protein 

0.48 

0.51 

0  03 

Vitamin  A 

061 

0.60 

•0  01 

Vitamin  C 

0  34 

0.33 

-0  01 

Iron 

0  49 

0.49 

0.00 

Calcium 

0  49 

0.55 

0  06 

All  Women 

Energy 

0  31 

0.32 

0.01 

Protein 

0  33 

0.34 

0  01 

Vitamin  A 

0  24 

0.24 

0  00 

Vitamin  C 

0  35 

0.35 

0  00 

Iron 

0  33 

0.33 

0  00 

Calcium 

0  40 

0.41 

0  01 
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NATIONAL  ESTIMATES  OF  NUTRIENT  INTAKE  FOR  WIC  WOMEN  AND 
CHILDREN 

Although  the  participant  recruitment  was  not  designed  to  be  representative  of  the 
nation-wide  WIC  client  population  (not  a  necessary  requirement  for  validation  studies),  a 
weighted  analysis  of  the  data  to  approximate  nutrient  estimates  for  this  population  was 
requested  by  OMB.  Using  the  recall  intake  data  from  this  validation  study,  estimations  could 
be  made  for  the  limited  population  of  African-American,  Mspanic  and  White  women  and 
children.  These  data  are  then  weighted  to  the  proportions  of  these  ethnic  groups  across  WIC 
categories  using  USDA's  1992  Study  of  WIC  Participant  and  Program  Characteristics.  The 
formula  used  for  the  weighting  is: 


Pij  is  the  number  of  WIC  participants  in  a  given  ethnic  group  ( i )  and  category  ( j  );. 
Ptot  is  the  total  number  of  African- American,  Hispanic  and  White  WIC  participants; 
Sy  is  the  number  of  study  participants  in  a  given  ethnic  group  ( i )  and  category  ( j ); 
Stot  is  the  total  number  of  African-American,  Hispanic  and  White  study  participants. 

The  proportions  used  for  the  WIC  participants  as  of  1992  are  as  follows: 


Wgt  =  (Py/Ptot)*(StOt/S,j) 


where: 


Women 

Non- 

Pregnant     Breastfeeding  Breastfeeding 


Total 
Women 


Children 


African-American 

Hispanic 

White 


0.16 
0.17 
0.28 


0.02 
0.06 
0.08 


0.07 
0.05 
0.11 


0.25 
0.28 
0.47 


0.30 
0.16 
0.54 


Total 


0.61 


0.16 


0.23 


1.00 


1.00 


The  results  of  these  weighted  estimates  are  shown  in  Table  E  6-1 . 
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Table  E  6-1 

National  Estimates  of  the  Nutrient  Intake  of 
WIC  Participants  based  on  African-American, 
Hispanic,  and  White  Diet  Recall  Data 

Weighted  to  1992  WIC  Participant  Data 


All  Women 

Children 

n  =  469 

n  =  181 

Nutrient 

Energy 

median 

1,927 

1.350 

(kcal) 

mean 

2,022 

1,359 

SD 

615 

396 

Protein 

median 

78.4 

50.8 

(gm) 

mean 

80.7 

51.1 

SD 

27.2 

14.4 

Vitamin  A 

median 

811 

549 

(RE) 

mean 

931 

616 

SD 

516 

291 

Vitamin  C 

median 

103 

71 

(mg) 

mean 

120 

78 

SD 

73 

42 

Iron 

median 

14.0 

10.0 

(mg) 

mean 

14.6 

10.6 

so 

5.4 

3.6 

Calcium 

median 

887 

719 

(mg) 

mean 

948 

732 

SD 

427 

768 
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